Skip to content

Commit ba1b5d0

Browse files
added fast_int8
1 parent 77b65bf commit ba1b5d0

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

flash_rl/vllm_patch.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -145,8 +145,7 @@ def hacked_process_weights_after_loading(
145145

146146
for name, p in all_updated_params.items():
147147
if name in updated_params:
148-
strided_data = torch.as_strided(
149-
p.data, hacked_data_dict[name].shape, hacked_data_dict[name].stride())
148+
strided_data = p.data.t()
150149
hacked_data_dict[name].copy_(strided_data)
151150
else:
152151
skipped_params.append(name)

0 commit comments

Comments
 (0)