From 99d9102d13e148280223c4ba860a308e5d71e65b Mon Sep 17 00:00:00 2001 From: Anant Sharma Date: Thu, 21 Aug 2025 10:14:18 -0700 Subject: [PATCH 1/3] docs: add trtllm known issue for al2023 --- docs/support_matrix.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/docs/support_matrix.md b/docs/support_matrix.md index 98e802dd56..0a7e017b23 100644 --- a/docs/support_matrix.md +++ b/docs/support_matrix.md @@ -42,6 +42,7 @@ If you are using a **GPU**, the following GPU models and architectures are suppo | **Ubuntu** | 24.04 | ARM64 | Experimental | | **CentOS Stream** | 9 | x86_64 | Experimental | + > [!Note] > For **Linux**, the **ARM64** support is experimental and may have limitations. > Wheels are built using a manylinux_2_28-compatible environment and they have been validated on CentOS 9 and Ubuntu (22.04, 24.04). @@ -79,8 +80,11 @@ If you are using a **GPU**, the following GPU models and architectures are suppo | **Host Operating System** | **Version** | **Architecture** | **Status** | | :------------------------ | :---------- | :--------------- | :----------- | -| **Amazon Linux** | 2023 | x86_64 | Supported | +| **Amazon Linux** | 2023 | x86_64 | Supported* | + +> [!Caution] +> * There is a known issue with the TensorRT-LLM framework when installed within the AL2023 container via the Python Wheels which makes effective environment setup challenging. ## Build Support From 1f07a7db9977501811ef03cb2a1202a541f5a670 Mon Sep 17 00:00:00 2001 From: Anant Sharma Date: Thu, 21 Aug 2025 13:37:27 -0400 Subject: [PATCH 2/3] fix space Signed-off-by: Anant Sharma --- docs/support_matrix.md | 1 - 1 file changed, 1 deletion(-) diff --git a/docs/support_matrix.md b/docs/support_matrix.md index 0a7e017b23..04bfcb4cd4 100644 --- a/docs/support_matrix.md +++ b/docs/support_matrix.md @@ -42,7 +42,6 @@ If you are using a **GPU**, the following GPU models and architectures are suppo | **Ubuntu** | 24.04 | ARM64 | Experimental | | **CentOS Stream** | 9 | x86_64 | Experimental | - > [!Note] > For **Linux**, the **ARM64** support is experimental and may have limitations. > Wheels are built using a manylinux_2_28-compatible environment and they have been validated on CentOS 9 and Ubuntu (22.04, 24.04). From 1e7b9109b043c2f19e35589b2a70c2006f274f10 Mon Sep 17 00:00:00 2001 From: Anant Sharma Date: Thu, 21 Aug 2025 13:41:41 -0400 Subject: [PATCH 3/3] use superscript Signed-off-by: Anant Sharma --- docs/support_matrix.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/support_matrix.md b/docs/support_matrix.md index 04bfcb4cd4..cad90a2542 100644 --- a/docs/support_matrix.md +++ b/docs/support_matrix.md @@ -71,7 +71,7 @@ If you are using a **GPU**, the following GPU models and architectures are suppo | **NIXL** | 0.4.1 | > [!Important] -> ² Specific versions of TensorRT-LLM supported by Dynamo are subject to change. +> Specific versions of TensorRT-LLM supported by Dynamo are subject to change. ## Cloud Service Provider Compatibility @@ -79,11 +79,11 @@ If you are using a **GPU**, the following GPU models and architectures are suppo | **Host Operating System** | **Version** | **Architecture** | **Status** | | :------------------------ | :---------- | :--------------- | :----------- | -| **Amazon Linux** | 2023 | x86_64 | Supported* | +| **Amazon Linux** | 2023 | x86_64 | Supported¹ | > [!Caution] -> * There is a known issue with the TensorRT-LLM framework when installed within the AL2023 container via the Python Wheels which makes effective environment setup challenging. +> ¹ There is a known issue with the TensorRT-LLM framework when installed within the AL2023 container via the Python Wheels which makes effective environment setup challenging. ## Build Support