Skip to content

Instantly share code, notes, and snippets.

@oglok

oglok/Adding some Jetson libs to RHAIIS

Created October 23, 2025 13:23
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save oglok/e3b7cd32f38b061471271e25d3e3753f to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save oglok/e3b7cd32f38b061471271e25d3e3753f to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Adding some Jetson libs to RHAIIS
FROM docker.io/library/ubuntu:22.04 AS build
RUN bash <<EOF
set -euxo pipefail
apt-get update
apt-get -y install curl
curl -O https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/arm64/cuda-keyring_1.1-1_all.deb
dpkg -i cuda-keyring_1.1-1_all.deb
apt-get update
apt-get -y install \
cuda-cupti-12-8 \
cuda-nvrtc-12-8 \
libcudnn9-cuda-12 \
libcublas-12-8 \
cuda-cudart-12-8 \
libcufft-12-8 \
libcusparse-12-8 \
libcusparselt0 \
libcusolver-12-8 \
libcurand-12-8 \
libcufile-12-8 \
libnvtoolsext1 \
libnvjitlink-12-8
apt-get download cuda-compat-12-8
dpkg --install --force-all cuda-compat-12-8_*_arm64.deb
EOF
# Reference: .ci/aarch64_linux/aarch64_wheel_ci_build.py
FROM registry.redhat.io/rhaiis/vllm-cuda-rhel9:latest
COPY --from=build --chmod=0555 \
/usr/local/cuda-12.8/targets/aarch64-linux/lib/libcupti.so.12 \
/usr/lib/aarch64-linux-gnu/libcudnn.so.9 \
/usr/local/cuda-12.8/targets/aarch64-linux/lib/libcublas.so.12 \
/usr/local/cuda-12.8/targets/aarch64-linux/lib/libcublasLt.so.12 \
/usr/local/cuda-12.8/targets/aarch64-linux/lib/libcudart.so.12 \
/usr/local/cuda-12.8/targets/aarch64-linux/lib/libcufft.so.11 \
/usr/local/cuda/lib64/libcusparse.so.12 \
/usr/lib/aarch64-linux-gnu/libcusparseLt.so.0 \
/usr/local/cuda-12.8/targets/aarch64-linux/lib/libcusolver.so.11 \
/usr/local/cuda-12.8/targets/aarch64-linux/lib/libcurand.so.10 \
/usr/lib/aarch64-linux-gnu/libnvToolsExt.so.1 \
/usr/local/cuda-12.8/targets/aarch64-linux/lib/libnvJitLink.so.12 \
/usr/local/cuda-12.8/targets/aarch64-linux/lib/libnvrtc.so.12 \
/usr/lib/aarch64-linux-gnu/libcudnn_adv.so.9 \
/usr/lib/aarch64-linux-gnu/libcudnn_cnn.so.9 \
/usr/lib/aarch64-linux-gnu/libcudnn_graph.so.9 \
/usr/lib/aarch64-linux-gnu/libcudnn_ops.so.9 \
/usr/lib/aarch64-linux-gnu/libcudnn_engines_runtime_compiled.so.9 \
/usr/lib/aarch64-linux-gnu/libcudnn_engines_precompiled.so.9 \
/usr/lib/aarch64-linux-gnu/libcudnn_heuristic.so.9 \
/usr/local/cuda-12.8/targets/aarch64-linux/lib/libnvrtc-builtins.so.12.8 \
/usr/local/cuda-12.8/targets/aarch64-linux/lib/libcufile.so.0 \
/usr/local/cuda-12.8/compat/libcuda.so.1.1 \
/usr/local/cuda-12.8/compat/libcudadebugger.so.1 \
/usr/local/cuda-12.8/compat/libnvcudla.so \
/usr/local/cuda-12.8/compat/libnvcuextend.so \
/usr/local/cuda-12.8/compat/libnvidia-nvvm.so \
/usr/local/cuda-12.8/compat/libnvidia-ptxjitcompiler.so \
/usr/local/cuda-12.8/compat/libcuda.so \
/usr/local/cuda-12.8/compat/libcuda.so.1 \
/usr/local/cuda-12.8/compat/libnvidia-nvvm.so.4 \
/usr/local/cuda-12.8/compat/libnvidia-ptxjitcompiler.so.1 \
/opt/cuda/lib/
ENV LD_LIBRARY_PATH=/opt/cuda/lib
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment