Skip to content

feat: support trtllm in sla-planner #2980

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tedzhouhk merged 36 commits into from
Sep 10, 2025
Merged

feat: support trtllm in sla-planner #2980

Changes from 1 commit
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
1aa8c32
chore: update CODEOWNERS for multimodal examples (#2878)
biswapanda Sep 5, 2025
ece24b1
first attempt
tedzhouhk Sep 8, 2025
c5633e1
add aiofiles
tedzhouhk Sep 9, 2025
0846ae7
fix trtllm docker file
tedzhouhk Sep 9, 2025
90b5ff1
Revert "fix trtllm docker file"
tedzhouhk Sep 9, 2025
f2a66cb
install requirement.txt
tedzhouhk Sep 9, 2025
4001324
add trtllm to sla planner
tedzhouhk Sep 9, 2025
ebc7611
fix: fix hermes tool call config (#2915)
ayushag-nv Sep 8, 2025
e63ec2e
ci: OPS-724: Move to ARC runners (#2904)
dillon-cullinan Sep 8, 2025
37f2778
fix: CI is broken with a deprecated dependency on pynvml (#2926)
saturley-hall Sep 8, 2025
cd1115a
fix: fix typo in multinode example (#2931)
julienmancuso Sep 8, 2025
327f3fe
ci: Add concurrency check to auto cancel running actions. (#2438)
pvijayakrish Sep 8, 2025
8b1b24c
chore: added utility to detect possible tool call start for a chunk (…
ayushag-nv Sep 8, 2025
d34cfdd
chore: add preference logic for using tool-call and reasoning parsers…
ayushag-nv Sep 8, 2025
dad62a5
Update README.md (#2938)
harryskim Sep 8, 2025
64ba7f3
build: OPS-597: restructure sglang to follow container strategy struc…
nv-tusharma Sep 8, 2025
766d5b2
refactor: standardize e2e tests across 3 frameworks (#2827)
alec-flowers Sep 8, 2025
e41c5bb
feat: automatically setup and inject prometheus configuration (#2912)
julienmancuso Sep 9, 2025
1803db8
fix: WAR DeepGemm JIT compilation errors (#2937)
GuanLuo Sep 9, 2025
a76fd70
ci: sglang functional tests (#2943)
alec-flowers Sep 9, 2025
8f1f965
feat: update benchmarking and deploy utils (#2933)
hhzhang16 Sep 9, 2025
4db7fcf
feat: Add a checksum to ModelDeploymentCard fields (#2934)
grahamking Sep 9, 2025
351464b
ci: Fix Dockerfile mount secrets (#2960)
dillon-cullinan Sep 9, 2025
51c75e1
chore: added tool call schema validation in oai formatter (#2935)
ayushag-nv Sep 9, 2025
f7090a3
test: remove nighlty marker in kvbm tests (#2958)
nv-anants Sep 9, 2025
f5644ef
ci: remove pre-merge ignore in github workflow (#2940)
nv-anants Sep 9, 2025
1a412eb
ci: longer timeout, change model for l40 (#2951)
alec-flowers Sep 9, 2025
b19deaf
fix: aggregate logprobs (#2928)
messiaen Sep 9, 2025
7148426
fix: no reasoning parser by default (#2939)
nealvaidya Sep 9, 2025
a2e3b52
docs: fix broken links (#2965)
nv-nmailhot Sep 9, 2025
37213b6
feat: add a virtual connector for 3rd party deployments (#2913)
tedzhouhk Sep 9, 2025
3af3425
fix: dyn namespace scoping for trtllm
biswapanda Sep 9, 2025
436307c
pc
tedzhouhk Sep 10, 2025
e62f664
remove duplicate
tedzhouhk Sep 10, 2025
a4a3e66
Merge branch 'main' of https://github.com/ai-dynamo/dynamo into hzhou…
tedzhouhk Sep 10, 2025
e6ac2a7
address pr comment
tedzhouhk Sep 10, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
chore: update CODEOWNERS for multimodal examples (#2878) 
Signed-off-by: Biswa Panda <[email protected]>
Signed-off-by: hongkuanz <[email protected]>
  • Loading branch information
@biswapanda @tedzhouhk
biswapanda authored and tedzhouhk committed Sep 10, 2025
commit 1aa8c32a29502ff150cf040b00346c70850d8b2a
2 changes: 1 addition & 1 deletion CODEOWNERS
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ Cargo.toml @ai-dynamo/dynamo-rust-codeowners
# Examples
/examples/ @ai-dynamo/Devops @nnshah1 @whoisj @nealvaidya @ishandhanani @ai-dynamo/dynamo-rust-codeowners
/examples/*/deploy/ @hutm @biswapanda @ishandhanani @julienmancuso @hhzhang16 @mohammedabdulwahhab @atchernych
/examples/multimodal/ @indrajit96 @krishung5 @whoisj @hhzhang16
/examples/multimodal/ @indrajit96 @krishung5 @whoisj @hhzhang16 @biswapanda

# CI/CD
/.github/ @ai-dynamo/Devops @nnshah1
Expand Down