🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with LLMs faster and more controllable.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Train transformer language models with reinforcement learning.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

FlashInfer: Kernel Library for LLM Serving

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

One API for plugins and datasets, one interface for prompt engineering and visual operation, all for creating powerful AI applications.

Efficient LLM Inference over Long Sequences

[ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the diverse strengths of multiple open-source LLMs. LLM-Blender cut …

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.

A benchmark for emotional intelligence in large language models

OpenAI 接口管理 & 分发系统，支持 Azure、Anthropic Claude、Google PaLM 2、智谱 ChatGLM、百度文心一言、讯飞星火认知以及阿里通义千问，可用于二次分发管理 key，仅单可执行文件，已打包好 Docker 镜像，一键部署，开箱即用. OpenAI key management & redistribution system, using a si…

FastGPT is a knowledge-based question answering system based on the LLM language model, providing out-of-the-box capabilities for data processing, model invocation, and more. It also allows for com…

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

Go ahead and axolotl questions

Pipeline Parallelism for PyTorch

test

a gae proxy

Minerva: a fast and flexible tool for deep learning. It provides ndarray programming interface, just like Numpy. Python bindings and C++ bindings are both available. The resulting code can be run o…

Protocol Buffers - Google's data interchange format

Caffe: a fast framework for deep learning. For the most recent version checkout the dev branch. For the latest stable release checkout the master branch.

Container Cluster Manager

Easy-to-use,Modular and Extendible package of deep-learning based CTR models .

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Open-source keyboard firmware for Atmel AVR and Arm USB families