A PyTorch native platform for training generative AI models

Python package built to ease deep learning on graph, on top of existing DL frameworks.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

A high-throughput and memory-efficient inference and serving engine for LLMs

A Datacenter Scale Distributed Inference Serving Framework

verl: Volcano Engine Reinforcement Learning for LLMs

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

Training and serving large-scale neural networks

Workflow engine for Kubernetes

An Open Source Machine Learning Framework for Everyone

🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

The Open-Channel SSD User Space Library

Hystrix is a latency and fault tolerance library designed to isolate points of access to remote systems, services and 3rd party libraries, stop cascading failure and enable resilience in complex di…

Apache Nemo Incubating

Mirror of Apache REEF