Create and manage Amazon SageMaker HyperPod clusters, run distributed model training

BioNeMo Framework: For building and adapting AI models in drug discovery at scale

CUDA Core Compute Libraries

Content repository for Community.aws

Expert Parallelism Load Balancer

Megatron's multi-modal data loader

Documentation that simply works

Specification for the Model Context Protocol

A scalable generative AI framework built for researchers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.

NVIDIA Ingest is an early access set of microservices for parsing hundreds of thousands of complex, messy unstructured PDFs and other enterprise documents into metadata and text to embed into retri…

NVIDIA Federated Learning Application Runtime Environment

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team co…

Portable (POSIX/Windows/Emscripten) thread pool for C/C++

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

Fast, streaming indexing, query, and agentic LLM applications in Rust

An Open Source Machine Learning Framework for Everyone

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…

A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment…

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory…