Skip to content

Commit c826508

Browse files
author
Kong-Aobo
committed
add SDPO
1 parent 9406bd7 commit c826508

File tree

449 files changed

+440545
-0
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

449 files changed

+440545
-0
lines changed

‎SDPO/LLaMA-Factory/.dockerignore‎

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
.vscode
2+
.git
3+
.github
4+
.venv
5+
cache
6+
data
7+
docker
8+
saves
9+
hf_cache
10+
output
11+
.dockerignore
12+
.gitattributes
13+
.gitignore

‎SDPO/LLaMA-Factory/.env.local‎

Lines changed: 34 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,34 @@
1+
# Note: actually we do not support .env, just for reference
2+
# api
3+
API_HOST=0.0.0.0
4+
API_PORT=8000
5+
API_KEY=
6+
API_MODEL_NAME=gpt-3.5-turbo
7+
FASTAPI_ROOT_PATH=
8+
# general
9+
DISABLE_VERSION_CHECK=
10+
FORCE_CHECK_IMPORTS=
11+
LLAMAFACTORY_VERBOSITY=
12+
USE_MODELSCOPE_HUB=
13+
RECORD_VRAM=
14+
# torchrun
15+
FORCE_TORCHRUN=
16+
MASTER_ADDR=
17+
MASTER_PORT=
18+
NNODES=
19+
RANK=
20+
NPROC_PER_NODE=
21+
# wandb
22+
WANDB_DISABLED=
23+
WANDB_PROJECT=huggingface
24+
WANDB_API_KEY=
25+
# gradio ui
26+
GRADIO_SHARE=False
27+
GRADIO_SERVER_NAME=0.0.0.0
28+
GRADIO_SERVER_PORT=
29+
GRADIO_ROOT_PATH=
30+
# setup
31+
ENABLE_SHORT_CONSOLE=1
32+
# reserved (do not use)
33+
LLAMABOARD_ENABLED=
34+
LLAMABOARD_WORKDIR=

‎SDPO/LLaMA-Factory/.gitattributes‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
# Auto detect text files and perform LF normalization
2+
* text=auto

‎SDPO/LLaMA-Factory/.gitignore‎

Lines changed: 169 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,169 @@
1+
# Byte-compiled / optimized / DLL files
2+
__pycache__/
3+
*.py[cod]
4+
*$py.class
5+
6+
# C extensions
7+
*.so
8+
9+
# Distribution / packaging
10+
.Python
11+
build/
12+
develop-eggs/
13+
dist/
14+
downloads/
15+
eggs/
16+
.eggs/
17+
lib/
18+
lib64/
19+
parts/
20+
sdist/
21+
var/
22+
wheels/
23+
share/python-wheels/
24+
*.egg-info/
25+
.installed.cfg
26+
*.egg
27+
MANIFEST
28+
29+
# PyInstaller
30+
# Usually these files are written by a python script from a template
31+
# before PyInstaller builds the exe, so as to inject date/other infos into it.
32+
*.manifest
33+
*.spec
34+
35+
# Installer logs
36+
pip-log.txt
37+
pip-delete-this-directory.txt
38+
39+
# Unit test / coverage reports
40+
htmlcov/
41+
.tox/
42+
.nox/
43+
.coverage
44+
.coverage.*
45+
.cache
46+
nosetests.xml
47+
coverage.xml
48+
*.cover
49+
*.py,cover
50+
.hypothesis/
51+
.pytest_cache/
52+
cover/
53+
54+
# Translations
55+
*.mo
56+
*.pot
57+
58+
# Django stuff:
59+
*.log
60+
local_settings.py
61+
db.sqlite3
62+
db.sqlite3-journal
63+
64+
# Flask stuff:
65+
instance/
66+
.webassets-cache
67+
68+
# Scrapy stuff:
69+
.scrapy
70+
71+
# Sphinx documentation
72+
docs/_build/
73+
74+
# PyBuilder
75+
.pybuilder/
76+
target/
77+
78+
# Jupyter Notebook
79+
.ipynb_checkpoints
80+
81+
# IPython
82+
profile_default/
83+
ipython_config.py
84+
85+
# pyenv
86+
# For a library or package, you might want to ignore these files since the code is
87+
# intended to run in multiple environments; otherwise, check them in:
88+
# .python-version
89+
90+
# pipenv
91+
# According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
92+
# However, in case of collaboration, if having platform-specific dependencies or dependencies
93+
# having no cross-platform support, pipenv may install dependencies that don't work, or not
94+
# install all needed dependencies.
95+
#Pipfile.lock
96+
97+
# poetry
98+
# Similar to Pipfile.lock, it is generally recommended to include poetry.lock in version control.
99+
# This is especially recommended for binary packages to ensure reproducibility, and is more
100+
# commonly ignored for libraries.
101+
# https://python-poetry.org/docs/basic-usage/#commit-your-poetrylock-file-to-version-control
102+
#poetry.lock
103+
104+
# pdm
105+
# Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
106+
#pdm.lock
107+
# pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
108+
# in version control.
109+
# https://pdm.fming.dev/#use-with-ide
110+
.pdm.toml
111+
112+
# PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
113+
__pypackages__/
114+
115+
# Celery stuff
116+
celerybeat-schedule
117+
celerybeat.pid
118+
119+
# SageMath parsed files
120+
*.sage.py
121+
122+
# Environments
123+
.env
124+
.venv
125+
env/
126+
venv/
127+
ENV/
128+
env.bak/
129+
venv.bak/
130+
131+
# Spyder project settings
132+
.spyderproject
133+
.spyproject
134+
135+
# Rope project settings
136+
.ropeproject
137+
138+
# mkdocs documentation
139+
/site
140+
141+
# mypy
142+
.mypy_cache/
143+
.dmypy.json
144+
dmypy.json
145+
146+
# Pyre type checker
147+
.pyre/
148+
149+
# pytype static type analyzer
150+
.pytype/
151+
152+
# Cython debug symbols
153+
cython_debug/
154+
155+
# PyCharm
156+
# JetBrains specific template is maintained in a separate JetBrains.gitignore that can
157+
# be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
158+
# and can be added to the global gitignore or merged into this file. For a more nuclear
159+
# option (not recommended) you can uncomment the following to ignore the entire idea folder.
160+
.idea/
161+
162+
# custom .gitignore
163+
ms_cache/
164+
hf_cache/
165+
cache/
166+
config/
167+
saves/
168+
output/
169+
wandb/

‎SDPO/LLaMA-Factory/CITATION.cff‎

Lines changed: 44 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,44 @@
1+
cff-version: 1.2.0
2+
date-released: 2024-03
3+
message: "If you use this software, please cite it as below."
4+
authors:
5+
- family-names: "Zheng"
6+
given-names: "Yaowei"
7+
- family-names: "Zhang"
8+
given-names: "Richong"
9+
- family-names: "Zhang"
10+
given-names: "Junhao"
11+
- family-names: "Ye"
12+
given-names: "Yanhan"
13+
- family-names: "Luo"
14+
given-names: "Zheyan"
15+
- family-names: "Feng"
16+
given-names: "Zhangchi"
17+
- family-names: "Ma"
18+
given-names: "Yongqiang"
19+
title: "LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models"
20+
url: "https://arxiv.org/abs/2403.13372"
21+
preferred-citation:
22+
type: conference-paper
23+
conference:
24+
name: "Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)"
25+
authors:
26+
- family-names: "Zheng"
27+
given-names: "Yaowei"
28+
- family-names: "Zhang"
29+
given-names: "Richong"
30+
- family-names: "Zhang"
31+
given-names: "Junhao"
32+
- family-names: "Ye"
33+
given-names: "Yanhan"
34+
- family-names: "Luo"
35+
given-names: "Zheyan"
36+
- family-names: "Feng"
37+
given-names: "Zhangchi"
38+
- family-names: "Ma"
39+
given-names: "Yongqiang"
40+
title: "LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models"
41+
url: "https://arxiv.org/abs/2403.13372"
42+
year: 2024
43+
publisher: "Association for Computational Linguistics"
44+
address: "Bangkok, Thailand"

0 commit comments

Comments
 (0)