Skip to content

Fix bugs in initial_load_in_hf when enable_weight_tying=true in Qwen3 #1964

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 6 commits into from
Closed

Fix bugs in initial_load_in_hf when enable_weight_tying=true in Qwen3 #1964

Changes from 1 commit
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
d57d3a0
Fix bugs in initial_load_in_hf when enable_weight_tying=true in Qwen3
Achazwl Oct 29, 2025
a005f0f
Update torchtitan/models/qwen3/model/state_dict_adapter.py
Achazwl Oct 30, 2025
978746f
Update torchtitan/models/qwen3/model/state_dict_adapter.py
Achazwl Oct 30, 2025
63d5b5f
Remove the shadow copy of hf_state_dict
Achazwl Oct 31, 2025
8a23f6e
fix lint
Achazwl Nov 4, 2025
bb5db8e
Merge branch 'main' of https://github.com/pytorch/torchtitan into pat…
Achazwl Nov 6, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Merge branch 'main' of https://github.com/pytorch/torchtitan into pat… 
…ch-1
  • Loading branch information
@Achazwl
Achazwl committed Nov 6, 2025
commit bb5db8e5cc58ad27819db375f5860def90f6d96f

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.