Skip to content

feat: Support Dynamo KVBM with TRTLLM Disagg #3527

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jthomson04 wants to merge 21 commits into
base: main
Choose a base branch
from
+336 −152
Open

feat: Support Dynamo KVBM with TRTLLM Disagg #3527

Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
2d2e8df
Support disaggregation with KVBM and TRTLLM
jthomson04 Oct 9, 2025
b537618
Wire up connector to trtllm component and support trtllm in disagg de…
jthomson04 Oct 10, 2025
21a5928
Run connector with prefill worker
jthomson04 Oct 11, 2025
1cad35a
Cleanup
jthomson04 Oct 24, 2025
6927c39
fmt
jthomson04 Oct 24, 2025
fa19f67
Merge remote-tracking branch 'origin/main' into jthomson04/kvbm-trtll…
jthomson04 Nov 24, 2025
58f5968
Fix connector path
jthomson04 Nov 24, 2025
b00b282
Merge remote-tracking branch 'origin/main' into jthomson04/kvbm-trtll…
jthomson04 Nov 24, 2025
a701194
Update docs
jthomson04 Nov 24, 2025
5d134df
Check for version compatibility
jthomson04 Nov 24, 2025
667e155
precommit
jthomson04 Nov 24, 2025
cce0e3d
Merge branch 'main' into jthomson04/kvbm-trtllm-disagg
jthomson04 Nov 25, 2025
8a2d280
Merge branch 'main' into jthomson04/kvbm-trtllm-disagg
jthomson04 Nov 30, 2025
1386c07
Merge branch 'main' into jthomson04/kvbm-trtllm-disagg
jthomson04 Dec 1, 2025
41ed735
Merge branch 'main' into jthomson04/kvbm-trtllm-disagg
jthomson04 Dec 8, 2025
d856a14
Merge branch 'main' into jthomson04/kvbm-trtllm-disagg
jthomson04 Dec 12, 2025
bab61a0
Merge remote-tracking branch 'origin/main' into jthomson04/kvbm-trtll…
jthomson04 Dec 12, 2025
616cea9
Merge remote-tracking branch 'origin/main' into jthomson04/kvbm-trtll…
jthomson04 Dec 13, 2025
8fc1724
Little fixes
jthomson04 Dec 13, 2025
474fa6e
fix kv block size
jthomson04 Dec 13, 2025
0c7646b
Better error message
jthomson04 Dec 13, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge remote-tracking branch 'origin/main' into jthomson04/kvbm-trtll… 
…m-disagg
  • Loading branch information
@jthomson04
jthomson04 committed Nov 24, 2025
commit b00b282fba0d49d976e9b98d7929e7b07a0c0712

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.