Created
July 14, 2025 19:48
-
-
Save neto-developer/2606cdf9ebe06f31f3a3710351200f89 to your computer and use it in GitHub Desktop.
vLLM - Provising Script for vLLM - unsloth/DeepSeek-R1-Distill-Llama-70B-unsloth-bnb-4bit
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| # Cause the script to exit on failure. | |
| set -eo pipefail | |
| # Activate the main virtual environment | |
| . /venv/main/bin/activate | |
| # Install your packages | |
| pip install bitsandbytes --prefer-binary | |
| pip install -U vllm | |
| supervisorctl restart vllm |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment