Skip to content

Conversation

@alec-flowers
Copy link
Contributor

@alec-flowers alec-flowers commented Jul 11, 2025

Overview:

Remove old examples that use the old UX. Also clear the integration tests for the old vLLM. Will include new tests shortly for the new vLLM folder.

Summary by CodeRabbit

  • Removals

    • All "hello_world", "llm_hello_world", and "multinode_example" example applications, including their documentation, configuration files, and code, have been deleted.
    • The "llm" example’s initialization file has been removed.
    • All related supporting utilities and components for these examples have been deleted.
  • Documentation

    • Updated README files for deprecated examples to include clear deprecation notices and guidance on migration.

@coderabbitai
Copy link
Contributor

coderabbitai bot commented Jul 11, 2025

Walkthrough

This change removes all source code, configuration files, and documentation related to the "hello_world", "llm_hello_world", and "multinode_example" examples, as well as their subcomponents and pipelines, from the repository. Additionally, it updates the README files for deprecated LLM-related examples to include explicit deprecation notices and removal timelines.

Changes

File(s) Change Summary
examples/hello_world/README.md, config.yaml, hello_world.py, deploy/hello_world.yaml Entire hello_world example and its deployment/configuration files deleted
examples/hello_world/disagg_skeleton/* (all .py, README.md) All components (frontend, processor, router, workers, utils, graph) and documentation deleted
examples/hello_world/multinode_example/* (all .py, README.md, configs/*.yaml) All multinode example components, utilities, configs, and documentation deleted
examples/llm_hello_world/llm_hello_world.py, llm_types.py All code and type definitions for the llm_hello_world example deleted
examples/llm/components/init.py Empty init file with license header deleted
examples/llm_deprecated/README.md, examples/vllm_v0_deprecated/README.md Added deprecation notices and removal timelines to deprecated LLM example READMEs

Poem

The garden’s been weeded, old code swept away,
Examples and configs now bid us good day.
Deprecation bunnies hop with a sign,
“Move to vllm, all will be fine!”
Fresh fields await where new code will play,
As rabbits rejoice in a tidier hay.

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share
🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>, please review it.
    • Explain this complex logic.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai explain this code block.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read src/utils.ts and explain its main purpose.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
    • @coderabbitai help me debug CodeRabbit configuration file.

Support

Need help? Create a ticket on our support page for assistance with any issues or questions.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (Invoked using PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai full review to do a full review from scratch and review all the files again.
  • @coderabbitai summary to regenerate the summary of the PR.
  • @coderabbitai generate sequence diagram to generate a sequence diagram of the changes in this PR.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai configuration to show the current CodeRabbit configuration for the repository.
  • @coderabbitai help to get help.

Other keywords and placeholders

  • Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 0

🧹 Nitpick comments (2)
examples/vllm_v0_deprecated/README.md (1)

18-21: Use the same admonition style as the rest of the README for consistency

Later in the document, deprecation / warning messages use the > [!NOTE] & > [!WARNING] call-out blocks. Re-formatting the new deprecation banner to that style keeps the file visually consistent and easier to scan.

-# VLLM_0 example is deprecated
-# Please move to the new vllm folder
-# We will not be maintaining this example and will remove it by 0.4.0
+> [!WARNING]
+> The `vllm_v0` example is **deprecated** and will be removed in **0.4.0**.
+> Please migrate to the up-to-date examples in `examples/vllm`.
examples/llm_deprecated/README.md (1)

18-21: Convert the deprecation banner to an admonition & avoid multiple top-level H1 headers

Three consecutive # headings introduce duplicate H1s and push the existing document title (line 22) down the hierarchy.
Switching to a single admonition preserves heading structure, provides better visual emphasis, and lets you hyperlink the new location.

-# llm example is deprecated
-# Please move to the new vllm folder
-# We will not be maintaining this example and will remove it by 0.4.0
+> [!WARNING]
+> **Deprecated** – This folder will be removed in `v0.4.0`.  
+> Please migrate to [`examples/vllm`](../vllm/); no further updates will be made here.

Also ensure any hard-coded paths later in the doc (cd $DYNAMO_HOME/examples/llm) are updated or annotated as legacy to avoid confusing users once the folder is renamed/removed.

📜 Review details

Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 35c5606 and c83860e.

⛔ Files ignored due to path filters (5)
  • examples/hello_world/multinode_example/_img/1workerready.png is excluded by !**/*.png
  • examples/hello_world/multinode_example/_img/2workerready.png is excluded by !**/*.png
  • examples/hello_world/multinode_example/_img/waiting1worker.png is excluded by !**/*.png
  • examples/llm_deprecated/benchmarks/example_plots/single_node_pareto_plot.png is excluded by !**/*.png
  • examples/llm_deprecated/benchmarks/example_plots/two_node_pareto_plot.png is excluded by !**/*.png
📒 Files selected for processing (25)
  • examples/hello_world/README.md (0 hunks)
  • examples/hello_world/config.yaml (0 hunks)
  • examples/hello_world/deploy/hello_world.yaml (0 hunks)
  • examples/hello_world/disagg_skeleton/README.md (0 hunks)
  • examples/hello_world/disagg_skeleton/components/frontend.py (0 hunks)
  • examples/hello_world/disagg_skeleton/components/graph.py (0 hunks)
  • examples/hello_world/disagg_skeleton/components/kv_router.py (0 hunks)
  • examples/hello_world/disagg_skeleton/components/prefill_worker.py (0 hunks)
  • examples/hello_world/disagg_skeleton/components/processor.py (0 hunks)
  • examples/hello_world/disagg_skeleton/components/utils.py (0 hunks)
  • examples/hello_world/disagg_skeleton/components/worker.py (0 hunks)
  • examples/hello_world/hello_world.py (0 hunks)
  • examples/hello_world/multinode_example/README.md (0 hunks)
  • examples/hello_world/multinode_example/components/frontend.py (0 hunks)
  • examples/hello_world/multinode_example/components/graph.py (0 hunks)
  • examples/hello_world/multinode_example/components/processor.py (0 hunks)
  • examples/hello_world/multinode_example/components/utils.py (0 hunks)
  • examples/hello_world/multinode_example/components/worker.py (0 hunks)
  • examples/hello_world/multinode_example/configs/multi_worker.yaml (0 hunks)
  • examples/hello_world/multinode_example/configs/one_worker.yaml (0 hunks)
  • examples/llm/components/__init__.py (0 hunks)
  • examples/llm_deprecated/README.md (1 hunks)
  • examples/llm_hello_world/llm_hello_world.py (0 hunks)
  • examples/llm_hello_world/llm_types.py (0 hunks)
  • examples/vllm_v0_deprecated/README.md (2 hunks)
💤 Files with no reviewable changes (23)
  • examples/hello_world/README.md
  • examples/hello_world/multinode_example/configs/multi_worker.yaml
  • examples/hello_world/multinode_example/components/graph.py
  • examples/llm/components/init.py
  • examples/hello_world/multinode_example/configs/one_worker.yaml
  • examples/hello_world/disagg_skeleton/components/graph.py
  • examples/hello_world/config.yaml
  • examples/llm_hello_world/llm_types.py
  • examples/hello_world/deploy/hello_world.yaml
  • examples/hello_world/multinode_example/components/frontend.py
  • examples/hello_world/multinode_example/components/worker.py
  • examples/hello_world/disagg_skeleton/components/frontend.py
  • examples/hello_world/disagg_skeleton/components/kv_router.py
  • examples/hello_world/multinode_example/components/processor.py
  • examples/hello_world/disagg_skeleton/components/worker.py
  • examples/hello_world/disagg_skeleton/components/prefill_worker.py
  • examples/hello_world/disagg_skeleton/README.md
  • examples/hello_world/multinode_example/README.md
  • examples/hello_world/disagg_skeleton/components/utils.py
  • examples/hello_world/disagg_skeleton/components/processor.py
  • examples/hello_world/hello_world.py
  • examples/llm_hello_world/llm_hello_world.py
  • examples/hello_world/multinode_example/components/utils.py
🧰 Additional context used
🧠 Learnings (3)
📓 Common learnings
Learnt from: PeaBrane
PR: ai-dynamo/dynamo#1409
File: examples/router_standalone/worker.py:171-186
Timestamp: 2025-06-08T08:30:45.126Z
Learning: Example code in the `examples/` directory may intentionally use hard-coded values or simplified implementations that wouldn't be appropriate for production code, but are acceptable for demonstration and testing purposes.
Learnt from: biswapanda
PR: ai-dynamo/dynamo#1412
File: lib/bindings/python/src/dynamo/runtime/logging.py:100-100
Timestamp: 2025-06-06T21:48:35.214Z
Learning: In the Dynamo codebase, BentoML has been completely removed from all executable code, with only documentation and attribution references remaining. The error_loggers configuration in lib/bindings/python/src/dynamo/runtime/logging.py should not include "bentoml" since those modules no longer exist.
examples/llm_deprecated/README.md (2)
Learnt from: PeaBrane
PR: ai-dynamo/dynamo#1409
File: examples/router_standalone/worker.py:171-186
Timestamp: 2025-06-08T08:30:45.126Z
Learning: Example code in the `examples/` directory may intentionally use hard-coded values or simplified implementations that wouldn't be appropriate for production code, but are acceptable for demonstration and testing purposes.
Learnt from: krishung5
PR: ai-dynamo/dynamo#1388
File: examples/multimodal/utils/model.py:47-53
Timestamp: 2025-06-09T17:52:06.761Z
Learning: The current get_vision_embeddings_size() function in examples/multimodal/utils/model.py uses a hardcoded fallback of 4096 for hidden_size, which assumes all VLMs follow the LLaVA architecture pattern. This is problematic because different VLMs like Qwen2-VL, MiniCPM-V, and others have different hidden dimensions, making the fallback unreliable and potentially causing tensor shape mismatches.
examples/vllm_v0_deprecated/README.md (1)
Learnt from: PeaBrane
PR: ai-dynamo/dynamo#1409
File: examples/router_standalone/worker.py:171-186
Timestamp: 2025-06-08T08:30:45.126Z
Learning: Example code in the `examples/` directory may intentionally use hard-coded values or simplified implementations that wouldn't be appropriate for production code, but are acceptable for demonstration and testing purposes.
⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (1)
  • GitHub Check: Build and Test - vllm

Copy link
Contributor

@ishandhanani ishandhanani left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lit

@alec-flowers alec-flowers force-pushed the aflowers/deprecate-old-ux branch from 74390b8 to a8a2ac9 Compare July 11, 2025 23:30
@alec-flowers alec-flowers requested a review from ryanolson as a code owner July 11, 2025 23:30
@alec-flowers alec-flowers changed the title refactor: add deprecation warnings and rename folders refactor: remove examples with old UX Jul 11, 2025
@alec-flowers alec-flowers changed the title refactor: remove examples with old UX refactor: remove old examples with old UX Jul 11, 2025
@alec-flowers alec-flowers enabled auto-merge (squash) July 14, 2025 16:02
Copy link
Contributor

@nnshah1 nnshah1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Follow up action items:

  1. add e2e basic tests (bash based)
  2. add new k8s yamls

@alec-flowers alec-flowers merged commit f00d700 into main Jul 14, 2025
12 of 13 checks passed
@alec-flowers alec-flowers deleted the aflowers/deprecate-old-ux branch July 14, 2025 16:55
@biswapanda
Copy link
Contributor

CI e2e tests (Compound AI k8s tests and Fault-Tolerence) will break and we might not catch regressions.
we need to get back:

  1. CI tests
  2. hello world example (cpu based)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants