Skip to content

[CP] Enable FlexCP for llama3 #2145

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
fegin wants to merge 8 commits into
base: gh/fegin/54/base
Choose a base branch
from
Open

[CP] Enable FlexCP for llama3 #2145

Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
4c06750
Update
fegin Dec 11, 2025
44a2d8c
Update
fegin Dec 11, 2025
4c950e8
Update
fegin Dec 12, 2025
3bd90f8
Update
fegin Dec 12, 2025
0803909
Update on "[CP] Enable FlexCP for llama3"
fegin Dec 15, 2025
c4f3886
Update on "[CP] Enable FlexCP for llama3"
fegin Dec 15, 2025
e18f9ad
Update
fegin Dec 16, 2025
21e2a5d
Update
fegin Dec 16, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update on "[CP] Enable FlexCP for llama3" 
Summary:

Continue the previous PR, this PR enable FlexAttention + CP for llama3. FlexCP will use PTRRLoadBalancer.

Note that this PR requires pytorch/pytorch#170201

[ghstack-poisoned]
  • Loading branch information
@fegin
fegin committed Dec 15, 2025
commit c4f3886f6d92cd16239530bbee81e3a5427e0a72

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.