Skip to content
Merged
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update components README.md
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
  • Loading branch information
athreesh authored Jul 28, 2025
commit c4df262e920f5e0e0388783405f1dd3556ebd8f7
8 changes: 2 additions & 6 deletions components/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,11 +27,7 @@ Dynamo supports multiple inference engines (with a focus on SGLang, vLLM, and Te
- **[SGLang](backends/sglang/README.md)** - Structured generation language framework with ZMQ-based communication
- **[TensorRT-LLM](backends/trtllm/README.md)** - NVIDIA's optimized LLM inference engine with TensorRT acceleration

Each engine provides launch scripts for different deployment patterns in their respective `/launch` & `/deploy` directories:
- Aggregated serving
- Aggregated serving with KV routing
- Disaggregated serving
- Disaggregated serving with KV routing
Each engine provides launch scripts for different deployment patterns in their respective `/launch` & `/deploy` directories.

## Core Components

Expand Down Expand Up @@ -111,4 +107,4 @@ To get started with Dynamo components:
4. **Run deployment scripts** from the engine's launch directory
5. **Monitor performance** using the metrics component

For detailed instructions, see the README files in each component directory and the main [Dynamo documentation](../../docs/).
For detailed instructions, see the README files in each component directory and the main [Dynamo documentation](../../docs/).
Loading