Skip to content

update #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
staoxiao merged 151 commits into from
Jan 16, 2024
Merged

update #1

staoxiao merged 151 commits into from
Jan 16, 2024

Conversation

@staoxiao
Copy link
Owner

@staoxiao staoxiao commented Jan 16, 2024

Why are these changes needed?

Related issue number (if applicable)

Checks

  • I've run format.sh to lint the changes in this PR.
  • I've included any doc changes needed.
  • I've made sure the relevant tests are passing (if applicable).

merrymercy and others added 30 commits September 21, 2023 22:45
@merrymercy
Fix falcon chat template (#2464)
2855bf9
@siddartha-RE
Fix chunk handling when partial chunks are returned (#2485)
f8f302f
@brandonbiggs
Update openai_api_server.py to add an SSL option (#2484)
15a094e
@shuishu
Update vllm_worker.py (#2482)
7aace7d
@asaiacai
fix typo quantization (#2469)
faca3a3
@merrymercy
fix vllm quanziation args
8e8a604
@merrymercy
Update README.md (#2492)
77b3df1
@hnyls2002
Huggingface api worker (#2456)
f5c90f6
@merrymercy
Update links to lmsys-chat-1m (#2497)
f70de6b
@Ying1123
Update train code to support the new tokenizer (#2498)
c478bbf
@enochlev
Third Party UI Example (#2499)
bc22411
@AlpinDale
Add metharme (pygmalion) conversation template (#2500)
6b4fc64
@siddartha-RE
Optimize for proper flash attn causal handling (#2503)
46e5207
@lerela
Add Mistral AI instruction template (#2483)
f5eee7d
@merrymercy
Update monitor & plots (#2506)
759dfbe
@merrymercy
Release v0.2.30 (#2507)
f9fcc9d
@toslunar
Fix for single turn dataset (#2509)
e64ee0e
@khalil-Hennara
replace os.getenv with os.path.expanduser because the first one doesn… (
c3ad73a 
#2515)

Co-authored-by: khalil <[email protected]>
@merrymercy
Fix arena (#2522)
5573aae
Update Dockerfile (#2524)
dad34ea
@lcw99
add Llama2ChangAdapter (#2510)
9d27d68
@leonxia1018
Add ExllamaV2 Inference Framework Support. (#2455)
466da28
@merrymercy
Improve docs (#2534)
5dbc4f3
@merrymercy
Fix warnings for new gradio versions (#2538)
e448a0f
@merrymercy
revert the gradio change; now works for 3.40
125f374
@merrymercy
Improve chat templates (#2539)
0c37d98
@lewtun
Add Zephyr 7B Alpha (#2535)
cd7d048
@Steve-Tech
Improve Support for Mistral-Instruct (#2547)
f5a4911
@liunux4odoo
correct max_tokens by context_length instead of raise exception (#2544)
f683fd1
@merrymercy
Revert "Improve Support for Mistral-Instruct" (#2552)
7b0ca39
natolambert and others added 29 commits December 23, 2023 21:10
@natolambert @codeviking
Add functionality to ping AI2 InferD endpoints for tulu 2 (#2832)
1ffdaee 
Co-authored-by: Sam Skjonsberg <[email protected]>
@liuyhwangyh
add download models from www.modelscope.cn (#2830)
c77b0a2 
Co-authored-by: mulin.lyh <[email protected]>
@zollty
Fix conv_template of chinese alpaca 2 (#2812)
c405ed6
@jondurbin
add bagel model adapter (#2814)
c214688
@stephanbertl
add root_path argument to gradio web server. (#2807)
43532db 
Co-authored-by: bertls <[email protected]>
@chiragjn
Import accelerate locally to avoid it as a strong dependency (#2820)
05755c2
@rudeigerc
Replace dict merge with unpacking for compatibility of 3.8 in vLLM wo…
0cf2886 
…rker (#2824)

Signed-off-by: rudeigerc <[email protected]>
@merrymercy
Format code (#2854)
c70bb3d
@andy-yang-1
Openai API migrate (#2765)
82ef3a3
@merrymercy
fix openai api server docs
093574d
@Ying1123
Add a16z as a sponser
e39ec88
@merrymercy @infwinston
Add new models (Perplexity, gemini) & Separate GPT versions (#2856)
a28563b 
Co-authored-by: Wei-Lin Chiang <[email protected]>
@merrymercy
Clean error messages (#2857)
bab105a
@Ying1123
Update docs (#2858)
e67b21d
@zhangsibo1129
Modify doc description (#2859)
5f7211d
@Jingsong-Yan
Fix the problem of not using the decoding method corresponding to the…
1f5c5f3 
… base model in peft mode (#2865)
@xiechengmude
update a new sota model on MT-Bench which touch an 8.8 scores. (#2864)
3623d9b
@jq460494839
NPU needs to be initialized when starting a new process (#2843)
1368f3f
Fix the problem with "vllm + chatglm3" (#2845) (#2876)
719022f 
Co-authored-by: 姚峰 <[email protected]>
@thavens
Update token spacing for mistral conversation.py (#2872)
4735aa7
@joshua-ne
check if hm in models before deleting to avoid errors (#2870)
722ab02 
Co-authored-by: Your Name <[email protected]>
@Gk-rohan
Add TinyLlama (#2889)
01a007a
@Jingsong-Yan
Fix bug that model doesn't automatically switch peft adapter (#2884)
2ed5c5e
@merrymercy
Update web server commands (#2869)
0fa13a6
@WHDY
fix the tokenize process and prompt template of chatglm3 (#2883)
cd59fd5 
Co-authored-by: 章焕锭 <[email protected]>
@gabrielmbmb @alvarobartt
Add Notus support (#2813)
f591012 
Co-authored-by: alvarobartt <[email protected]>
@congchan
feat: support anthropic api with api_dict (#2879)
2dbb9f1
@thavens
Update model_adapter.py (#2895)
06acba1
@infwinston
leaderboard code update (#2867)
6ff8505
@staoxiao staoxiao merged commit 389a889 into staoxiao:main Jan 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.