Added settings vllm#2599

Merged

merrymercy merged 10 commits intolm-sys:mainfrom

SebastianBodza:added_SettingsVLLM

Nov 1, 2023

Commits on Oct 17, 2023

Added top_k & penaltys
bodza
committed
Fixed top_k definition
bodza
committed
Added top_k to completion request
bodza
committed
typo ,
bodza
committed
Fixed 2nd typo smh
bodza
committed
added topk to ChatCompletionRequest
bodza
committed
Added top_p to @app.post("/v1/chat/completions", dependencies=[Depends(check_api_key)])
bodza
committed

Commits on Oct 24, 2023

ran format.sh
bodza
committed
Defaults from vllm
bodza
committed
Merge branch 'main' into added_SettingsVLLM
SebastianBodza
authored