Cherry-pick https://github.com/NVIDIA/TensorRT-LLM/pull/21 to main branch#38

juney-nvidia merged 1 commit intomainNVIDIA/TensorRT-LLM:mainfrom

kaiyu/cherry-pick-7295ce2NVIDIA/TensorRT-LLM:kaiyu/cherry-pick-7295ce2Copy head branch name to clipboard