Popular repositories Loading

1. tailor tailor Public

   mini llm infer engine w/ radix cache + paged attention + blockmanager

   Python 1

2. litellm litellm Public

   Forked from BerriAI/litellm

   Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr…

   Python

3. mistral-vibe mistral-vibe Public

   Forked from mistralai/mistral-vibe

   Minimal CLI coding agent by Mistral

   Python

4. nano-vllm nano-vllm Public

   Forked from GeeeekExplorer/nano-vllm

   Nano vLLM

   Python

5. mini-sglang mini-sglang Public

   Forked from sgl-project/mini-sglang

   A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

   Python

6. harbor harbor Public

   Forked from laude-institute/harbor

   Harbor is a framework for running agent evaluations and creating and using RL environments.

   Python