LLM IS AS GOOD AS YOU ARE

SGLang is a fast serving framework for large language models and vision language models.

Openwrt for Nanopi R1S R2S R4S 香橙派 R1 Plus 固件编译 纯净版与大杂烩

Examples for Recommenders - easy to train and deploy on accelerated infrastructure.

Recommend new arxiv papers of your interest daily according to your Zotero libarary.

Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

A Datacenter Scale Distributed Inference Serving Framework

Mixture-of-Experts for Large Vision-Language Models

Tensors and Dynamic neural networks in Python with strong GPU acceleration

🕸 A Node app for creating a Feed Reader in Notion.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

⏰ Collaboratively track deadlines of conferences recommended by CCF (Website, Python Cli, Wechat Applet) / If you find it useful, please star this project, thanks~

Examples of how to create colorful, annotated equations in Latex using Tikz.