Skip to content

Instantly share code, notes, and snippets.

@shacharmirkin

shacharmirkin/vllm_on_google_colab.ipynb

Last active April 26, 2025 12:58
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save shacharmirkin/60d3403909ea5a540f7e17f2c3f2581a to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save shacharmirkin/60d3403909ea5a540f7e17f2c3f2581a to your computer and use it in GitHub Desktop.
Download ZIP
Serving an LLM with vLMM on Google Colab
Display the source blob
Display the rendered blob
Raw
vllm_on_google_colab.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment