Skip to content

feat: Pr 4159 fixes #4417

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
atchernych wants to merge 11 commits into from
Closed

feat: Pr 4159 fixes #4417

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
8e9bcd6
recipes: Clean up incomplete recipes and clarify Kubernetes-only focus
BenHamm Nov 6, 2025
4947aaf
Remove emojis from README section headings
BenHamm Nov 6, 2025
30d7e2c
docs: add hyperlinks to recipe table for easier navigation
BenHamm Nov 6, 2025
e0592e6
docs: fix trailing whitespace in README
BenHamm Nov 6, 2025
7635f73
restore trtllm configs in examples/trtllm
biswapanda Nov 10, 2025
a49a434
Fix the TRTLLM engine config locations and references
tanmayv25 Nov 12, 2025
d639049
Fix the multinode documentation
tanmayv25 Nov 12, 2025
f6af901
Fix the reference directory
tanmayv25 Nov 12, 2025
de9a7b2
Apply suggestions from code review
tanmayv25 Nov 13, 2025
d201021
Add placeholder for the version
tanmayv25 Nov 13, 2025
9410f19
Add back GAIE integration
atchernych Nov 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix the reference directory
  • Loading branch information
@tanmayv25
tanmayv25 committed Nov 12, 2025
commit f6af901439d2e6eb4cfd6d9da5a8554dfec2d8f3
4 changes: 2 additions & 2 deletions docs/backends/trtllm/multinode/multinode-examples.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -108,8 +108,8 @@ export IMAGE="<dynamo_trtllm_image>"
# For example, assuming your cluster had a `/lustre` directory on the host, you
# could add that as a mount like so:
#
# export MOUNTS="${PWD}/../:/mnt,/lustre:/lustre"
export MOUNTS="${PWD}/../:/mnt"
# export MOUNTS="${PWD}/../../../../:/mnt,/lustre:/lustre"
export MOUNTS="${PWD}/../../../../:/mnt"

# NOTE: In general, Deepseek R1 is very large, so it is recommended to
# pre-download the model weights and save them in some shared location,
Expand Down
4 changes: 2 additions & 2 deletions docs/backends/trtllm/multinode/multinode-multimodal-example.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -73,8 +73,8 @@ export IMAGE="<dynamo_trtllm_image>"
# For example, assuming your cluster had a `/lustre` directory on the host, you
# could add that as a mount like so:
#
# export MOUNTS="${PWD}/../:/mnt,/lustre:/lustre"
export MOUNTS="${PWD}/../:/mnt"
# export MOUNTS="${PWD}/../../../../:/mnt,/lustre:/lustre"
export MOUNTS="${PWD}/../../../../:/mnt"

# Can point to local FS as weel
# export MODEL_PATH="/location/to/model"
Expand Down
Loading