awni/mlx_dgx_spark.md

Last active November 14, 2025 15:39

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/awni/95112d214b7ff6b3fae30a7bb1ec33a9.js"></script>
Save awni/95112d214b7ff6b3fae30a7bb1ec33a9 to your computer and use it in GitHub Desktop.

Download ZIP

MLX and MLX LM on DGX Spark

Raw

mlx_dgx_spark.md

Install CUDA deps:

sudo apt-get update
sudo apt-get install libcudnn9-dev-cuda-13
sudo apt-get install libblas-dev liblapack-dev liblapacke-dev
sudo apt-get install libnccl2 libnccl-dev

Install MLX:

CMAKE_ARGS="-DMLX_BUILD_CUDA=ON" pip install git+https://github.com/ml-explore/mlx

Install mlx-lm:

pip install mlx-lm

Run generation:

mlx_lm.generate --model Qwen/Qwen3-4B-Instruct-2507 --prompt "Tell me a story about Einstein"

LoRA fine-tune:

mlx_lm.lora --model Qwen/Qwen3-4B-Instruct-2507 --data mlx-community/WikiSQL --train

GamalZilo commented Nov 14, 2025

Awesome, thanks! Struggled with this until I found your solution.

awni/mlx_dgx_spark.md

Select an option

No results found

Select an option

No results found

GamalZilo commented Nov 14, 2025

Uh oh!