feat: support trtllm in sla-planner#2980

Merged

tedzhouhk merged 36 commits intomainfrom

hzhou/trtllm-sweep

Sep 10, 2025

Commits on Sep 10, 2025

chore: update CODEOWNERS for multimodal examples (#2878)

biswapanda
authored and
tedzhouhk
committed
first attempt
tedzhouhk
committed
add aiofiles
tedzhouhk
committed
fix trtllm docker file
tedzhouhk
committed
Revert "fix trtllm docker file"
tedzhouhk
committed
install requirement.txt
tedzhouhk
committed
add trtllm to sla planner
tedzhouhk
committed
fix: fix hermes tool call config (#2915)

ayushag-nv
authored and
tedzhouhk
committed
ci: OPS-724: Move to ARC runners (#2904)

dillon-cullinan
authored and
tedzhouhk
committed
fix: CI is broken with a deprecated dependency on pynvml (#2926)

authored and
tedzhouhk
committed
fix: fix typo in multinode example (#2931)

julienmancuso
authored and
tedzhouhk
committed
ci: Add concurrency check to auto cancel running actions. (#2438)

pvijayakrish
authored and
tedzhouhk
committed
chore: added utility to detect possible tool call start for a chunk (#2923)

ayushag-nv
authored and
tedzhouhk
committed
chore: add preference logic for using tool-call and reasoning parsers for sglang (#2922)

ayushag-nv
authored and
tedzhouhk
committed
Update README.md (#2938)

harryskim
authored and
tedzhouhk
committed
build: OPS-597: restructure sglang to follow container strategy structure (#2803)

nv-tusharma
authored and
tedzhouhk
committed
refactor: standardize e2e tests across 3 frameworks (#2827)

alec-flowers
authored and
tedzhouhk
committed
feat: automatically setup and inject prometheus configuration (#2912)

julienmancuso
authored and
tedzhouhk
committed
fix: WAR DeepGemm JIT compilation errors (#2937)

authored and
tedzhouhk
committed
ci: sglang functional tests (#2943)

alec-flowers
authored and
tedzhouhk
committed
feat: update benchmarking and deploy utils (#2933)

hhzhang16
authored and
tedzhouhk
committed
feat: Add a checksum to ModelDeploymentCard fields (#2934)

grahamking
authored and
tedzhouhk
committed
ci: Fix Dockerfile mount secrets (#2960)

dillon-cullinan
authored and
tedzhouhk
committed
chore: added tool call schema validation in oai formatter (#2935)

ayushag-nv
authored and
tedzhouhk
committed
test: remove nighlty marker in kvbm tests (#2958)

nv-anants
authored and
tedzhouhk
committed
ci: remove pre-merge ignore in github workflow (#2940)

nv-anants
authored and
tedzhouhk
committed
ci: longer timeout, change model for l40 (#2951)

alec-flowers
authored and
tedzhouhk
committed
fix: aggregate logprobs (#2928)

messiaen
authored and
tedzhouhk
committed
fix: no reasoning parser by default (#2939)

nealvaidya
authored and
tedzhouhk
committed
docs: fix broken links (#2965)

nv-nmailhot
authored and
tedzhouhk
committed
feat: add a virtual connector for 3rd party deployments (#2913)
tedzhouhk
committed
fix: dyn namespace scoping for trtllm

biswapanda
authored and
tedzhouhk
committed
pc
tedzhouhk
committed
remove duplicate
tedzhouhk
committed
Merge branch 'main' of https://github.com/ai-dynamo/dynamo into hzhou/trtllm-sweep
tedzhouhk
committed
address pr comment
tedzhouhk
committed