Skip to content

[Feature] Safe save with FSDP, slurm examples #1863

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
zhisbug wants to merge 18 commits into from
Closed

[Feature] Safe save with FSDP, slurm examples #1863

Changes from 1 commit
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
14adfbb
my working branch
zhisbug May 14, 2023
8d82a31
x former instead of attention
zhisbug May 15, 2023
ff7d3f6
update
zhisbug May 15, 2023
240661b
monkey patch
zhisbug May 15, 2023
dbbea0c
fix
zhisbug May 17, 2023
9193046
add slurm script
May 17, 2023
c479599
training job gpt-4 only
May 24, 2023
f6c6696
Remove train/test split
merrymercy May 29, 2023
134e408
Update train_vicuna_30b_single_node_slurm.sh
merrymercy May 29, 2023
3188916
13b training scripts
May 29, 2023
d2de83e
merge main
May 29, 2023
3271c08
update scripts
Jun 12, 2023
d443171
training scripts
zhisbug Jun 14, 2023
c926f58
push
zhisbug Jun 20, 2023
6e9cd5b
lanuch new jobs
zhisbug Jun 22, 2023
fee1dd8
update
zhisbug Jun 27, 2023
c84a002
add 65b training scripts
zhisbug Jul 19, 2023
4352c18
Merge branch 'main' into hao-fix-fsdp-save
zhisbug Jul 19, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Merge branch 'main' into hao-fix-fsdp-save
  • Loading branch information
@zhisbug
zhisbug committed Jul 19, 2023
commit 4352c18391766852d5dd3378da4bea7d09f51f23

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.