Skip to content

build: Fixes for vLLM Blackwell Builds #2020

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
alec-flowers merged 5 commits into from
Jul 23, 2025
Merged

build: Fixes for vLLM Blackwell Builds #2020

Changes from 1 commit
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
e45b3ab
get correct nightlies via seeing what prints on dry run pip install o…
zaristei Jul 20, 2025
a431bb7
fix nixl build args again
zaristei Jul 22, 2025
2b9aec5
rm flashinfer for now
zaristei Jul 22, 2025
3e0f381
install stable flashinfer for now
zaristei Jul 23, 2025
7c824ca
Merge branch 'main' into zaristei/vllm-blackwell-fixes
zaristei Jul 23, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
get correct nightlies via seeing what prints on dry run pip install o… 
…n b200
  • Loading branch information
@zaristei
zaristei committed Jul 22, 2025
commit e45b3abbdaf583bb4b12287251ccfa544db13ee6
7 changes: 4 additions & 3 deletions container/deps/vllm/install_vllm.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -119,9 +119,10 @@ if [ "$ARCH" = "arm64" ]; then

# Try to install specific PyTorch version first, fallback to latest nightly
echo "Attempting to install pinned PyTorch nightly versions..."
if ! uv pip install torch==2.9.0.dev20250712+cu128 torchvision==0.24.0.dev20250712+cu128 torchaudio==2.8.0.dev20250712+cu128 --index-url https://download.pytorch.org/whl/nightly/cu128; then
echo "Pinned versions failed, falling back to latest stable..."
uv pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu128
if ! uv pip install torch==2.8.0.dev20250613+cu128 torchaudio==2.8.0.dev20250616 torchvision==0.23.0.dev20250616 --index-url https://download.pytorch.org/whl/nightly/cu128; then
echo "Pinned versions failed"
exit 1
# uv pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu128
fi

python use_existing_torch.py
Expand Down
Loading