Qwen2-7B for pre-training and fine-tuning

[fjwang3]

Thanks for sharing your work, it's great. Can we use Qwen2-7B for pre-training and fine-tuning? Or Phi-3 or Phi-4?

[ZhangXJ199]

Sure, our repository supports customization. We have already provided scripts for the Qwen2 series, which can be used directly, while for Phi-3 and Phi-4 you will need to modify the scripts yourself.