A high-throughput and memory-efficient inference and serving engine for LLMs

A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone

Platform for stateful agents: AI with advanced memory that can learn and self-improve over time.

An extremely fast Python type checker and language server, written in Rust.

Nano vLLM

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

Python bindings for llama.cpp

The official PyTorch implementation of the paper "Human Motion Diffusion Model"

Import arbitrary code from Stack Overflow as Python modules.

A library for mechanistic interpretability of GPT-style language models

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of …

Browse the web with GPT-4V and Vimium

Code for BLT research paper

Measuring Massive Multitask Language Understanding | ICLR 2021

LLMs for your CLI

Multiversal tree writing interface for human-AI collaboration

BookNLP, a natural language processing pipeline for books

A character-level language diffusion model trained on Tiny Shakespeare

Run LLMs inside a PDF file.

easy to use retry decorator in python

Ollama for classical ML models. AOT compiler that turns XGBoost, LightGBM, scikit-learn, CatBoost & ONNX models into native C99 inference code. One command to load, one command to serve. 336x faste…

The long missing library for python confidence intervals

Simple random DNS, HTTP/S internet traffic noise generator in a Docker container

Pythonic Web Development

Image Classification Testing with LLMs

Python package developed to evaluate textual overlap (N-Grams) between two volumes of text.