Skip to content

Add support for transformers>=5.0 #416

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
kashif wants to merge 13 commits into
base: main
Choose a base branch
from
Open

Add support for transformers>=5.0 #416

Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
20edee2
add Transformer v5 changes
kashif Dec 2, 2025
784fcf1
add safe tensor
kashif Dec 2, 2025
ac46167
use from torch.nn import init
kashif Dec 5, 2025
c5ef527
Clean up comments related to Transformers v5
kashif Dec 5, 2025
1c270eb
Clean up comments related to weight initialization
kashif Dec 5, 2025
ba859f0
Merge branch 'main' into transformers-v5
kashif Dec 5, 2025
b64d9db
Apply suggestion from @kashif
kashif Dec 5, 2025
0e85ae6
Apply suggestion from @kashif
kashif Dec 5, 2025
f806213
add back super
kashif Dec 5, 2025
fc785d9
stack.set_input_embeddings(embed_tokens) not needed
kashif Dec 8, 2025
378a0d1
return directly
kashif Dec 8, 2025
691222d
Merge branch 'main' into transformers-v5
kashif Dec 8, 2025
aed4152
Merge branch 'main' into transformers-v5
kashif Dec 9, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Merge branch 'main' into transformers-v5
  • Loading branch information
@kashif
kashif authored Dec 9, 2025
commit aed41527dd756b64286fa85420221504a49a114e

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.