Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Resolve merge conflicts in README files
  • Loading branch information
athreesh committed Jul 29, 2025
commit e9dc0cbcc16ca5ab1bb8b3086a4c477f93ee73b2
8 changes: 0 additions & 8 deletions components/backends/trtllm/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -222,17 +222,9 @@ The migrated request will continue responding to the original request, allowing

See [client](../llm/README.md#client) section to learn how to send request to the deployment.

<<<<<<< HEAD
NOTE: To send a request to a multi-node deployment, target the node which is running `dynamo-run in=http`.
=======
NOTE: To send a request to a multi-node deployment, target the node which is running `python3 -m dynamo.frontend <args>`.
>>>>>>> origin/main

## Benchmarking

To benchmark your deployment with GenAI-Perf, see this utility script, configuring the
<<<<<<< HEAD
`model` name and `host` based on your deployment: [perf.sh](../../benchmarks/llm/perf.sh)
=======
`model` name and `host` based on your deployment: [perf.sh](../../../benchmarks/llm/perf.sh)
>>>>>>> origin/main
4 changes: 0 additions & 4 deletions components/backends/vllm/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -81,11 +81,7 @@ This includes the specific commit [vllm-project/vllm#19790](https://github.com/v
## Run Single Node Examples

> [!IMPORTANT]
<<<<<<< HEAD
> Below we provide simple shell scripts that run the components for each configuration. Each shell script runs `python3 dynamo.frontend` to start the ingress and uses `python3 dynamo.vllm` to start the vLLM workers. You can also run each command in separate terminals for better log visibility.
=======
> Below we provide simple shell scripts that run the components for each configuration. Each shell script runs `python3 -m dynamo.frontend` to start the ingress and uses `python3 -m dynamo.vllm` to start the vLLM workers. You can also run each command in separate terminals for better log visibility.
>>>>>>> origin/main

This figure shows an overview of the major components to deploy:

Expand Down