-
Notifications
You must be signed in to change notification settings - Fork 3.5k
[NV TensorRT RTX] Handle unsupported data types #25953
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
@chilo-ms @jywu-msft to review |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This PR adds data type validation to the NV TensorRT RTX execution provider to prevent crashes when models contain unsupported data types. The EP will now gracefully reject nodes with unsupported data types instead of crashing.
- Introduces data type checking functionality with supported type validation
- Updates tensor binding operations to handle INT4 and FLOAT8E4M3FN data types
- Integrates data type validation into the node capability assessment process
Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.
|
/azp run Linux QNN CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI,Windows ARM64 QNN CI Pipeline,Windows GPU Doc Gen CI Pipeline,Windows x64 QNN CI Pipeline |
|
Azure Pipelines successfully started running 5 pipeline(s). |
|
in the interest of time, i'm going to merge this and we can follow up on comments later. |
### Description <!-- Describe your changes. --> The EP will reject the node with unsupported data types. ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> The user will face a crash if the model with an unsupported datatype is used.
|
This PR has been cherry-picked into the |
Description
The EP will reject the node with unsupported data types.
Motivation and Context
The user will face a crash if the model with an unsupported datatype is used.