Skip to content

Conversation

@harryskim
Copy link
Contributor

@harryskim harryskim commented Sep 5, 2025

Update readme with links to support matrix, prebuilt containers from NGC, and blog articles.
Also updated kvbm support for TRT-LLM and vLLM

Summary by CodeRabbit

  • Documentation
    • Expanded top-level navigation with new links: Support Matrix, Prebuilt Containers, and Blogs for easier access to key resources.
    • Updated Framework Support Matrix: KVBM marked complete for vLLM and SGLang; TensorRT-LLM remains in progress, improving clarity on current framework support.
    • No code or functional changes; updates are documentation-only.

Update readme

Signed-off-by: Harry Kim <[email protected]>
@coderabbitai
Copy link
Contributor

coderabbitai bot commented Sep 5, 2025

Walkthrough

README.md updated to add three top navigation links and to modify the Framework Support Matrix: KVBM row marks vLLM and SGLang as complete and TensorRT-LLM as in progress. No code or API changes.

Changes

Cohort / File(s) Summary of changes
Top navigation links
README.md
Added links: Support matrix (docs/support_matrix.md), Prebuilt containers (NGC catalog URL), and Blogs (NVIDIA Developer blog tag).
Framework Support Matrix (KVBM row)
README.md
Updated KVBM status: vLLM ✅, SGLang ✅, TensorRT-LLM 🚧.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Possibly related PRs

Poem

I twitch my ears at links anew,
Three fresh trails for readers to pursue.
KVBM hops—checkmarks two!
One road still marked with caution’s hue.
Docs align, the garden’s neat—
A tidy warren of README treats. 🐇✨


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share
🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>, please review it.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.

Support

Need help? Create a ticket on our support page for assistance with any issues or questions.

CodeRabbit Commands (Invoked using PR/Issue comments)

Type @coderabbitai help to get the list of available commands.

Other keywords and placeholders

  • Add @coderabbitai ignore or @coderabbit ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

Status, Documentation and Community

  • Visit our Status Page to check the current availability of CodeRabbit.
  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🧹 Nitpick comments (1)
README.md (1)

24-24: Prefer relative links and title-case nav labels

Convert absolute GitHub paths for Support Matrix and Examples to relative links, and capitalize labels for consistency:

-| **[Roadmap](https://github.com/ai-dynamo/dynamo/issues/762)** | **[Support matrix](https://github.com/ai-dynamo/dynamo/blob/main/docs/support_matrix.md)** | **[Documentation](https://docs.nvidia.com/dynamo/latest/index.html)** | **[Examples](https://github.com/ai-dynamo/dynamo/tree/main/examples)** | **[Prebuilt containers](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo)** | **[Design Proposals](https://github.com/ai-dynamo/enhancements)** | **[Blogs](https://developer.nvidia.com/blog/tag/nvidia-dynamo)**
+| **[Roadmap](https://github.com/ai-dynamo/dynamo/issues/762)** | **[Support Matrix](docs/support_matrix.md)** | **[Documentation](https://docs.nvidia.com/dynamo/latest/index.html)** | **[Examples](examples/)** | **[Prebuilt Containers](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo)** | **[Design Proposals](https://github.com/ai-dynamo/enhancements)** | **[Blogs](https://developer.nvidia.com/blog/tag/nvidia-dynamo)**
📜 Review details

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

💡 Knowledge Base configuration:

  • MCP integration is disabled by default for public repositories
  • Jira integration is disabled by default for public repositories
  • Linear integration is disabled by default for public repositories

You can enable these sources in your CodeRabbit configuration.

📥 Commits

Reviewing files that changed from the base of the PR and between abf4caf and b2bc45d.

📒 Files selected for processing (1)
  • README.md (2 hunks)
🧰 Additional context used
🪛 LanguageTool
README.md

[grammar] ~63-~63: There might be a mistake here.
Context: ...ure/kvbm_architecture.md) | ✅ | ✅ | 🚧 | To learn more about each framework and t...

(QB_NEW_EN)

⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (1)
  • GitHub Check: Build and Test - dynamo

| [**Load Based Planner**](/docs/architecture/load_planner.md) | 🚧 | 🚧 | 🚧 |
| [**SLA-Based Planner**](/docs/architecture/sla_planner.md) ||| 🚧 |
| [**KVBM**](/docs/architecture/kvbm_architecture.md) | 🚧 | 🚧 | 🚧 |
| [**KVBM**](/docs/architecture/kvbm_architecture.md) | | | 🚧 |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Verification agent

🧩 Analysis chain

Validate KVBM status across backends; add legend and define acronym on first mention

Ensure the table reflects actual support in vLLM/SGLang and in-progress state for TensorRT-LLM. Consider adding a legend for ✅/🚧 and expanding KVBM on first use to avoid ambiguity.

Repo-level verification:

Suggested additions right below the table:

> Legend: ✅ Available • 🚧 In progress

> KVBM: Briefly define the acronym here (expand the full term) and link to the design doc above.

🏁 Script executed:

#!/bin/bash
# Scan for KVBM references across backends to corroborate the matrix.
rg -nPi --hidden --glob '!**/node_modules/**' 'kvbm|kv[-_ ]?aware|kv block memory' -C2 components/ docs/ | sed 's/^/HIT: /'
echo "Note: absence of matches is not proof; check backend READMEs and features as needed."

Length of output: 41833


Update KVBM support matrix, add legend, define acronym

  • In README.md table row for KVBM, change statuses to: 🚧 for vLLM (WIP), ❌ for SGLang (Planned), 🚧 for TensorRT-LLM.
  • Add immediately below the table:

    Legend: ✅ Available • 🚧 In progress • ❌ Planned

  • On first mention, expand “KVBM” to “KV Block Manager (KVBM)”.
🧰 Tools
🪛 LanguageTool

[grammar] ~63-~63: There might be a mistake here.
Context: ...ure/kvbm_architecture.md) | ✅ | ✅ | 🚧 | To learn more about each framework and t...

(QB_NEW_EN)

🤖 Prompt for AI Agents
In README.md around line 63, update the KVBM table row statuses to use the
requested symbols (set vLLM to 🚧, SGLang to ❌, TensorRT-LLM to 🚧), add a
legend line immediately below the table that reads "Legend: ✅ Available • 🚧 In
progress • ❌ Planned", and change the first occurrence of "KVBM" in the document
to "KV Block Manager (KVBM)". Ensure spacing and markdown table formatting
remain valid and the acronym expansion appears only on first mention.

@nvda-mesharma nvda-mesharma changed the title Update README.md docs: Update README.md Sep 5, 2025
@github-actions github-actions bot added the docs label Sep 5, 2025
@nvda-mesharma nvda-mesharma merged commit 357efee into main Sep 5, 2025
10 of 12 checks passed
@nvda-mesharma nvda-mesharma deleted the harryskim-patch-4 branch September 5, 2025 17:23
GavinZhu-GMI pushed a commit to GavinZhu-GMI/dynamo that referenced this pull request Sep 8, 2025
Signed-off-by: Harry Kim <[email protected]>
Signed-off-by: Gavin.Zhu <[email protected]>
@coderabbitai coderabbitai bot mentioned this pull request Sep 8, 2025
nnshah1 pushed a commit that referenced this pull request Sep 8, 2025
Signed-off-by: Harry Kim <[email protected]>
Signed-off-by: nnshah1 <[email protected]>
nnshah1 pushed a commit that referenced this pull request Sep 8, 2025
Signed-off-by: Harry Kim <[email protected]>
Signed-off-by: nnshah1 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants