Skip to content

Instantly share code, notes, and snippets.

@tcapelle

tcapelle/glm-47.-flash-sglang.yaml

Created January 22, 2026 17:57
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save tcapelle/38bd5c9b1fffcc5bd4adf5e69c72f8df to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save tcapelle/38bd5c9b1fffcc5bd4adf5e69c72f8df to your computer and use it in GitHub Desktop.
Download ZIP
Raw
glm-47.-flash-sglang.yaml
image: lmsysorg/sglang:latest
command:
- /bin/bash
- -c
- |
pip install --break-system-packages sglang==0.3.2.dev9039+pr-17247.g90c446848 --extra-index-url https://sgl-project.github.io/whl/pr/ && \
pip install --break-system-packages git+https://github.com/huggingface/transformers.git@76732b4e7120808ff989edbd16401f61fa6a0afa && \
python3 -m sglang.launch_server \
--model-path zai-org/GLM-4.7-Flash \
--trust-remote-code \
--tp 4 \
--tool-call-parser glm47 \
--mem-fraction-static 0.8 \
--attention-backend flashinfer \
--served-model-name glm-4.7-flash \
--watchdog-timeout 1800 \
--host 0.0.0.0 \
--port 8000
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment