doc/md
1
0
Fork 0
Code

add

Browse Source
This commit is contained in:
liushuang 2025-10-13 17:59:23 +08:00
parent 4282d90a96
commit 46fd91f090
1 changed files with 24 additions and 42 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

66
install-nvidia-smi.md
View File

@ -1,44 +1,9 @@
```shell ```shell
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-ubuntu2404.pin wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-keyring_1.1-1_all.deb
``` sudo dpkg -i cuda-keyring_1.1-1_all.deb
```shell
sudo mv cuda-ubuntu2404.pin /etc/apt/preferences.d/cuda-repository-pin-600
```
```shell
wget https://developer.download.nvidia.com/compute/cuda/12.5.1/local_installers/cuda-repo-ubuntu2404-12-5-local_12.5.1-555.42.06-1_amd64.deb
```
```shell
sudo dpkg -i cuda-repo-ubuntu2404-12-5-local_12.5.1-555.42.06-1_amd64.deb
```
```shell
sudo cp /var/cuda-repo-ubuntu2404-12-5-local/cuda-*-keyring.gpg /usr/share/keyrings/
```
```shell
sudo apt-get update sudo apt-get update
``` sudo apt-get -y install cuda-toolkit-12-8
sudo apt-get install -y cuda-drivers
```shell
sudo apt-get -y install cuda-toolkit-12-5
```
重启
```shell
nano ~/.bashrc
```
```shell
# NVIDIA CUDA Toolkit Environment Variables
export PATH=/usr/local/cuda-12.5/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-12.5/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}
```
```shell
source ~/.bashrc
``` ```
```shell ```shell
@ -49,9 +14,26 @@ nvidia-smi
nvcc -V nvcc -V
``` ```
下载 gpt-oss-20b 模型
```shell ```shell
https://www.modelscope.cn/models/openai-mirror/gpt-oss-20b conda create --name test-vllm-gpt-oss-20b-crash python=3.12 -y
``` ```
```shell
conda activate test-vllm-gpt-oss-20b-crash
```
```shell
model
```
```shell
python --version
```
```shell
pip install vllm
```
下载 gpt-oss-20b 模型