Yuan-2.0/megatron/core at main · IEIT-Yuan/Yuan-2.0 · GitHub

Name		Name	Last commit message	Last commit date
parent directory ..
fusions		fusions
models		models
pipeline_parallel		pipeline_parallel
tensor_parallel		tensor_parallel
transformer		transformer
README.md		README.md
__init__.py		__init__.py
enums.py		enums.py
model_parallel_config.py		model_parallel_config.py
package_info.py		package_info.py
parallel_state.py		parallel_state.py
requirements.txt		requirements.txt
utils.py		utils.py

README.md

Megatron Core is a library for efficient and scalable training of transformer based models.