Skip to content
Closed
Next Next commit
recipes: Clean up incomplete recipes and clarify Kubernetes-only focus
Remove incomplete model directories and non-Kubernetes configurations to
streamline the recipes directory for production Kubernetes deployments.

Changes:
- Remove 5 incomplete model directories (deepseek-r1-distill-llama-8b,
  gemma3, llama4, qwen2-vl-7b-instruct, qwen3) that lack proper
  Kubernetes deployment manifests
- Delete run.sh script (non-Kubernetes automation tool)
- Remove standalone engine config YAMLs from deepseek-r1/trtllm that
  were not wrapped in Kubernetes manifests
- Document incomplete gpt-oss-120b disagg recipe with README explaining
  missing components

README improvements:
- Restructure Available Recipes table with 'Deployment' and 'Benchmark
  Recipe' columns to clarify that perf.yaml files are tools for users
  to run benchmarks, not published performance results
- Add comprehensive quick start guide with prerequisites
- Link to correct Kubernetes deployment guides
- Add troubleshooting section
- Remove extraneous links (docs.nvidia.com, license section)

Result: 4 models with 10 complete deployment recipes (7 with benchmark
scripts), focused exclusively on Kubernetes deployments.

Signed-off-by: Ben Hamm <[email protected]>
  • Loading branch information
BenHamm committed Nov 6, 2025
commit 8e9bcd6b0f7da008bedc9295cd009c8808ced079
396 changes: 185 additions & 211 deletions recipes/README.md

Large diffs are not rendered by default.

34 changes: 0 additions & 34 deletions recipes/deepseek-r1-distill-llama-8b/trtllm/agg.yaml

This file was deleted.

31 changes: 0 additions & 31 deletions recipes/deepseek-r1-distill-llama-8b/trtllm/decode.yaml

This file was deleted.

30 changes: 0 additions & 30 deletions recipes/deepseek-r1-distill-llama-8b/trtllm/prefill.yaml

This file was deleted.

51 changes: 0 additions & 51 deletions recipes/deepseek-r1/trtllm/agg/mtp/mtp_agg.yaml

This file was deleted.

56 changes: 0 additions & 56 deletions recipes/deepseek-r1/trtllm/agg/simple/agg.yaml

This file was deleted.

29 changes: 0 additions & 29 deletions recipes/deepseek-r1/trtllm/agg/wide_ep/dep16_agg.yaml

This file was deleted.

7 changes: 0 additions & 7 deletions recipes/deepseek-r1/trtllm/agg/wide_ep/eplb.yaml

This file was deleted.

39 changes: 0 additions & 39 deletions recipes/deepseek-r1/trtllm/agg/wide_ep/wide_ep_agg.yaml

This file was deleted.

57 changes: 0 additions & 57 deletions recipes/deepseek-r1/trtllm/disagg/mtp/mtp_decode.yaml

This file was deleted.

41 changes: 0 additions & 41 deletions recipes/deepseek-r1/trtllm/disagg/mtp/mtp_prefill.yaml

This file was deleted.

Loading