Alpa
Alpa.ai offers tutorials and documentation for distributed training using its parallelization API. Alpa's `parallelize` function simplifies parallelizing JAX computations. The platform supports both shard and pipeline parallelism.