Skip to content

feat: migrate requests when planner shutdown decode engine (vllm) #2280

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tedzhouhk merged 14 commits into from
Aug 5, 2025
Merged

feat: migrate requests when planner shutdown decode engine (vllm) #2280

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
4d597e2
stage
tedzhouhk Jul 30, 2025
a6a79be
change to engine shutdown error
tedzhouhk Jul 31, 2025
510cc77
quit silently
tedzhouhk Jul 31, 2025
0552068
raise GeneratorExit
tedzhouhk Jul 31, 2025
be1a631
[WIP] Allow PyGeneratorExit to end stream without final flag
kthui Aug 2, 2025
1dbf28b
Merge branch 'main' of https://github.com/ai-dynamo/dynamo into hzhou…
tedzhouhk Aug 4, 2025
32b0238
Merge branch 'jacky-ft-migrate-py-migrate' of https://github.com/ai-d…
tedzhouhk Aug 4, 2025
97cd70c
update knobs
tedzhouhk Aug 4, 2025
c29a591
pc
tedzhouhk Aug 4, 2025
623636c
Update components/backends/vllm/src/dynamo/vllm/main.py
tedzhouhk Aug 5, 2025
49413f4
fmt
tedzhouhk Aug 5, 2025
e408889
Merge branch 'hzhou/planner-migrate-shutdown' of https://github.com/a…
tedzhouhk Aug 5, 2025
216e5d1
fmt
tedzhouhk Aug 5, 2025
66a9217
Merge branch 'main' of https://github.com/ai-dynamo/dynamo into hzhou…
tedzhouhk Aug 5, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Merge branch 'main' of https://github.com/ai-dynamo/dynamo into hzhou… 
…/planner-migrate-shutdown
  • Loading branch information
@tedzhouhk
tedzhouhk committed Aug 5, 2025
commit 66a9217bdd96e98c1d4f5a47df0809b0ea4929ab

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.