🎙️ Talon config for coding by voice. Work in progress, unstable, I will force-push. Not intended for general consumption.

LLM inference in C/C++

ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)

ArcticInference: vLLM plugin for high-throughput, low-latency inference

A high-throughput and memory-efficient inference and serving engine for LLMs

A framework for few-shot evaluation of autoregressive language models.

Supercharge Your LLM with the Fastest KV Cache Layer

Unsloth Fine-tuning Notebooks for Google Colab, Kaggle, Hugging Face and more.

CUDA programming in Julia.

Code Samples from Neural Networks for NLP

Usefull Layers for Knet

Relax! Flux is the ML library that doesn't make you tensor

Neural Network primitives with multiple backends

Bridge Bidding Playground in Knet