md/install-nvidia-smi.md

因清华大学开源镜像站 HTTP/403 换了中科大的镜像站

cat /etc/apt/sources.list

安装了英伟达显卡驱动

wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-keyring_1.1-1_all.deb
sudo dpkg -i cuda-keyring_1.1-1_all.deb
sudo apt-get update
sudo apt-get -y install cuda-toolkit-12-8
sudo apt-get install -y cuda-drivers

nvidia-smi

安装了CUDA Toolkit

apt install nvidia-cuda-toolkit

nvcc -V

用 conda 创建了一个 python=3.12 的环境

conda create -n vllm-py12 python=3.12

conda activate vllm-py12

pip install vllm --extra-index-url https://download.pytorch.org/whl/cu128