Skip to content

[feat] add validation shuffle #1886

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
vermouth1992 merged 3 commits into from
Jun 7, 2025
Merged

[feat] add validation shuffle #1886

Changes from 1 commit
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
ec271f9
add validation_shuffle
0x0C001 Jun 6, 2025
0b78b66
add validation_shuffle
0x0C001 Jun 6, 2025
11726bd
add validation_shuffle
0x0C001 Jun 7, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
add validation_shuffle
  • Loading branch information
@0x0C001
0x0C001 authored Jun 6, 2025
commit ec271f96e7fcf6973a155131c66449c357651553
1 change: 1 addition & 0 deletions verl/trainer/config/ppo_trainer.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ data:
return_raw_chat: False
return_full_prompt: False
shuffle: True
validation_shuffle: True
Copy link
Collaborator

@vermouth1992 vermouth1992 Jun 7, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shall we not modify the default behavior?

Copy link
Contributor Author

@0x0C001 0x0C001 Jun 7, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👌

filter_overlong_prompts: False # for large-scale dataset, filtering overlong prompts could be timeconsuming. You cat set the filter_overlong_prompts_workers to use multiprocessing to speed up.
filter_overlong_prompts_workers: 1
truncation: error
Expand Down