Skip to content

fix: Update tensorrt_llm to 1.0.0rc6 #2606

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tanmayv25 merged 10 commits into from
Aug 22, 2025
Merged

fix: Update tensorrt_llm to 1.0.0rc6 #2606

Changes from 1 commit
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
cdc657d
Update tensorrt_llm to 1.0.0rc6
tanmayv25 Aug 21, 2025
db943a6
Update cuda runtime container
tanmayv25 Aug 21, 2025
2809dad
Improve multimodal instructions
tanmayv25 Aug 21, 2025
b79e673
rename
tanmayv25 Aug 21, 2025
79a7ef2
fix
tanmayv25 Aug 21, 2025
0e7d015
More docs
tanmayv25 Aug 21, 2025
2e159ab
Update
tanmayv25 Aug 21, 2025
4b6d6b1
Fix dependency versions
tanmayv25 Aug 21, 2025
639a9a6
Fix torchvision version
tanmayv25 Aug 21, 2025
9376e7e
Format
tanmayv25 Aug 21, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix dependency versions
  • Loading branch information
@tanmayv25
tanmayv25 committed Aug 21, 2025
commit 4b6d6b179607f782124d97363c20df381a61d813
6 changes: 3 additions & 3 deletions container/Dockerfile.trtllm
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -425,15 +425,15 @@ COPY --from=build /usr/local/cuda/lib64/libcudart.so* /usr/local/cuda/lib64/
COPY --from=build /usr/local/cuda/nvvm /usr/local/cuda/nvvm

# Copy pytorch installation from NGC PyTorch
ARG TORCH_VER=2.8.0a0+5228986c39.nv25.5
ARG TORCH_VER=2.8.0a0+5228986c39.nv25.6
ARG TORCHVISION_VER=0.22.0a0
ARG SETUPTOOLS_VER=78.1.1
ARG PYTORCH_TRITON_VER=3.3.0+git96316ce52.nvinternal
ARG JINJA2_VER=3.1.6
ARG NETWORKX_VER=3.4.2
ARG NETWORKX_VER=3.5
ARG SYMPY_VER=1.14.0
ARG PACKAGING_VER=23.2
ARG FLASH_ATTN_VER=2.7.3
ARG FLASH_ATTN_VER=2.7.4.post1
ARG MPMATH_VER=1.3.0
COPY --from=build /usr/local/lib/lib* /usr/local/lib/
COPY --from=build /usr/local/lib/python3.12/dist-packages/torch /usr/local/lib/python3.12/dist-packages/torch
Expand Down
Loading