Skip to content

Instantly share code, notes, and snippets.

@mdierolf

mdierolf/GLM 4.5

Created November 5, 2025 20:45
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save mdierolf/9c52af050076ff84aac037bdeb80c235 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save mdierolf/9c52af050076ff84aac037bdeb80c235 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
GLM 4.5
llama-server \
-hf bartowski/cerebras_GLM-4.5-Air-REAP-82B-A12B-GGUF:Q6_K \
-a glm/glm-air-4.5 \
--chat-template-file glm-chat-template.jinja \
--jinja \
--host 0.0.0.0 \
--port 11434 \
--ctx-size 145000 \
--no-mmap \
-fa on \
-kvu
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment