Skip to content
Merged
Changes from 1 commit
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
0658a83
add inc woq and remove itrex dependency
changwangss Aug 27, 2024
4955b8a
Update optimum/intel/neural_compressor/modeling_base.py
changwangss Aug 29, 2024
7fe5ac5
Update optimum/intel/neural_compressor/modeling_base.py
changwangss Aug 29, 2024
1d6797c
Update optimum/intel/neural_compressor/modeling_base.py
changwangss Aug 29, 2024
ab178e9
Update optimum/intel/neural_compressor/modeling_base.py
changwangss Aug 29, 2024
c078ca2
fix code according comment
changwangss Aug 29, 2024
c257101
add logger setting
changwangss Aug 29, 2024
d55004b
improve ut
changwangss Aug 29, 2024
fcadbac
move woq quantization to quantization.py
changwangss Sep 5, 2024
8cf22de
Update examples/neural_compressor/language-modeling/run_clm.py
changwangss Sep 5, 2024
a31fc6a
Update examples/neural_compressor/language-modeling/run_clm.py
changwangss Sep 5, 2024
3b5f228
remove dependency
changwangss Sep 5, 2024
7f8c2a2
Update examples/neural_compressor/language-modeling/run_clm.py
IlyasMoutawwakil Sep 5, 2024
6eba7c4
add woq saving and loading ut and logger info
changwangss Sep 5, 2024
2683608
Merge branch 'main' into wangchang/inc_woq
changwangss Sep 5, 2024
1401c89
set transformers version limit
changwangss Sep 5, 2024
bc3b95a
fix installation neural_compressor[pt]
changwangss Sep 6, 2024
99f797d
improve ut
changwangss Sep 6, 2024
8321a24
refactoring
echarlaix Sep 6, 2024
08091bc
Refactor
echarlaix Sep 6, 2024
09acbd9
revert
echarlaix Sep 6, 2024
28a10d9
fix datasets loading issue
changwangss Sep 9, 2024
1ad67f1
fix
echarlaix Sep 9, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update examples/neural_compressor/language-modeling/run_clm.py
  • Loading branch information
IlyasMoutawwakil authored Sep 5, 2024
commit 7f8c2a2e35699684a3c20c40727838eee6a9568f
2 changes: 1 addition & 1 deletion examples/neural_compressor/language-modeling/run_clm.py
Original file line number Diff line number Diff line change
Expand Up @@ -774,7 +774,7 @@ def compute_metrics(eval_preds):
)
trainer.model = quantizer._quantized_model

if optim_args.apply_quantization and optim_args.quantization_approach in {"weight_only"}:
if optim_args.apply_quantization and optim_args.quantization_approach == "weight_only":
model = trainer.model if isinstance(trainer.model, PreTrainedModel) else trainer.model._model
num_calibration_samples = min(len(train_dataset), optim_args.num_calibration_samples)
train_dataset = train_dataset.select(range(num_calibration_samples))
Expand Down