Skip to content

Default FP16 TensorRT export #6798

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
glenn-jocher merged 19 commits into from
Mar 6, 2022
Merged

Default FP16 TensorRT export #6798

Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
ac409f2
Assert engine precision #6777
DavidBaldsiefen Feb 27, 2022
c891005
Default to FP32 inputs for TensorRT engines
DavidBaldsiefen Mar 4, 2022
fd186fc
Default to FP16 TensorRT exports #6777
DavidBaldsiefen Mar 4, 2022
5be4bf3
Remove wrong line #6777
DavidBaldsiefen Mar 4, 2022
18d0d8d
Merge branch 'master' into 6777-assert-engine-precision
glenn-jocher Mar 4, 2022
ea07f73
Merge branch 'master' into 6777-assert-engine-precision
glenn-jocher Mar 4, 2022
a2c7b67
Automatically adjust detect.py input precision #6777
DavidBaldsiefen Mar 5, 2022
468b0d5
Automatically adjust val.py input precision #6777
DavidBaldsiefen Mar 5, 2022
fb64186
Add missing colon
DavidBaldsiefen Mar 5, 2022
56910be
Merge branch 'master' into 6777-assert-engine-precision
glenn-jocher Mar 6, 2022
038e1c2
Merge branch 'master' into 6777-assert-engine-precision
glenn-jocher Mar 6, 2022
60fc01b
Cleanup
glenn-jocher Mar 6, 2022
a4ee737
Cleanup
glenn-jocher Mar 6, 2022
d2b27ff
Remove default trt_fp16_input definition
glenn-jocher Mar 6, 2022
321e00d
Experiment
glenn-jocher Mar 6, 2022
06dbd2b
Reorder detect.py if statement to after half checks
glenn-jocher Mar 6, 2022
9e6b785
Update common.py
glenn-jocher Mar 6, 2022
9f4c374
Update export.py
glenn-jocher Mar 6, 2022
48c4deb
Cleanup
glenn-jocher Mar 6, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Cleanup
  • Loading branch information
@glenn-jocher
glenn-jocher authored Mar 6, 2022
commit 60fc01bc1e8555dcfce9361026a40cbe20ebb213
3 changes: 2 additions & 1 deletion val.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -144,7 +144,8 @@ def run(data,
model.model.half() if half else model.model.float()
elif engine:
if model.trt_fp16_input != half:
LOGGER.info('model ' + ('requires' if model.trt_fp16_input else 'incompatible with') + ' --half. Adjusting automatically.')
LOGGER.info('model ' + (
'requires' if model.trt_fp16_input else 'incompatible with') + ' --half. Adjusting automatically.')
half = model.trt_fp16_input
batch_size = model.batch_size
else:
Expand Down