Skip to content

[TRTLLM-7412][feat] Turn off spec decode when the rolling average acceptance length drops below threshold. #7283

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
zheyuf merged 14 commits into from
Oct 13, 2025

Merge branch 'main' into roll_avg

fb99df0
Select commit
Loading
Failed to load commit list.
Merged

[TRTLLM-7412][feat] Turn off spec decode when the rolling average acceptance length drops below threshold. #7283

Merge branch 'main' into roll_avg
fb99df0
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 13, 2025 in 0s

DCO

All commits are signed off!

View more details on DCO