On every machine in the cluster install openmpi and mlx-lm:
conda install conda-forge::openmpi
pip install -U mlx-lmNext download the pipeline parallel run script. Download it to the same path on every machine:
Leo Z leozusa
awni
/ mlx_distributed_deepseek.md
Last active
December 9, 2025 03:54
Run DeepSeek R1 or V3 with MLX Distributed