Skip to content

Enable yolov5 Example for TF 3x API #1943

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
Jul 26, 2024
Merged

Enable yolov5 Example for TF 3x API #1943

Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
fb579ab
Enable yolov5 Example for TF 3x API
zehao-intel Jul 22, 2024
7ce78eb
fix script
zehao-intel Jul 23, 2024
fdecd9b
set bf16 op
zehao-intel Jul 24, 2024
736b67c
select dtype
zehao-intel Jul 24, 2024
6d0b9b5
fix pre commit
zehao-intel Jul 24, 2024
f7b1921
fix import
zehao-intel Jul 24, 2024
aa9d186
fix benchmark
zehao-intel Jul 25, 2024
8e8c1e3
fix accuracy log
zehao-intel Jul 25, 2024
eddad28
fix inbench
zehao-intel Jul 25, 2024
20d92d5
Merge branch 'master' into zehao/yolo
zehao-intel Jul 25, 2024
454148c
fix conflict
zehao-intel Jul 26, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
set bf16 op 
Signed-off-by: zehao-intel <[email protected]>
  • Loading branch information
@zehao-intel
zehao-intel committed Jul 24, 2024
commit fdecd9b8e4de1e1a63ae7157e85fa64f9795a9f9
7 changes: 7 additions & 0 deletions examples/3.x_api/tensorflow/object_detection/yolo_v5/quantization/ptq/main.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -275,6 +275,13 @@ def main():
from neural_compressor.tensorflow import StaticQuantConfig, quantize_model

quant_config = StaticQuantConfig(weight_granularity="per_channel")
bf16_config = StaticQuantConfig(weight_dtype="bf16", act_dtype="bf16")
quant_config.set_local("functional_16_1/tf_conv_1/sequential_1/conv2d_1/convolution", bf16_config)
quant_config.set_local("functional_16_1/tf_conv_1_2/sequential_1_1/conv2d_1_1/convolution", bf16_config)
quant_config.set_local("functional_16_1/tfc3_1/tf_conv_2_1/conv2d_2_1/convolution", bf16_config)
quant_config.set_local("functional_16_1/tfc3_1/sequential_2_1/tf_bottleneck_1/tf_conv_5_1/conv2d_5_1/convolution", bf16_config)
quant_config.set_local("functional_16_1/tfc3_1/tf_conv_3_1/conv2d_3_1/convolution", bf16_config)
quant_config.set_local("functional_16_1/tfc3_1/tf_conv_4_1/conv2d_4_1/convolution", bf16_config)
q_model = quantize_model(args.input_model, quant_config, calib_func=evaluate)
q_model.save(args.output_model)

Expand Down