Pipeline Parallel Training with Apple SiliconJanuary 2026
Exploring the technical challenges of implementing model-parallel training on Apple Silicon. Using MLX, I built a system to finetune DeepSeek (671GB) across multiple Mac Studios connected via Thunderbolt.