Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Nov 7, 2025

• [Feat] Add support for SGLang quantization

  Show description for 7c82823
  yaof20

  authored
  7c82823

  Copy full SHA for 7c82823

Commits on Oct 29, 2025

• Check model type and organize code.

  

  lijunyong

  committed
  dc50b41

  Copy full SHA for dc50b41

• Restore setup.py.

  

  lijunyong

  committed
  7f7f4ab

  Copy full SHA for 7f7f4ab

• Backup weight_scale in cpu memory and restore them after reloading, because all weights will be set as zero by sglang if enable_memory_saver is set as True.

  

  lijunyong

  committed
  433a0e0

  Copy full SHA for 433a0e0

• Clone existing params instead of creating empty tensors to fix the bug of qkv_weight caused by loading qkv respectively.

  

  lijunyong

  committed
  be4c72c

  Copy full SHA for be4c72c

• Clean python and torch cache only once per updating weights.

  

  lijunyong

  committed
  ebbb260

  Copy full SHA for ebbb260

• Only operate on updated params for batch weight updates.

  

  lijunyong

  committed
  c0598a0

  Copy full SHA for c0598a0

• Modify code and verify weights reloading of sglang.

  

  lijunyong

  committed
  b376da7

  Copy full SHA for b376da7

• Finish patched load_weights_and_postprocess, the program can run now.

  

  lijunyong

  committed
  12fc6db

  Copy full SHA for 12fc6db

• Patch load_weights_and_postprocess of sglang; Bugs exist.

  

  lijunyong

  committed
  fcb0ce3

  Copy full SHA for fcb0ce3

• Patch sglang Engine.

  

  lijunyong

  committed
  62061f2

  Copy full SHA for 62061f2

Commits on Sep 29, 2025

• Merge pull request #35 from sallyjunjun/patch-1

  Show description for b963a27
  LiyuanLucasLiu

  authored
  b963a27

  Copy full SHA for b963a27

• add load_column_parallel_weight to recorded_loader_keys

  Show description for 4eefac8
  sallyjunjun

  authored
  4eefac8

  Copy full SHA for 4eefac8

Commits on Sep 27, 2025

• Clarify installation instructions in README

  Show description for 9678b51
  LiyuanLucasLiu

  authored
  9678b51

  Copy full SHA for 9678b51

• Add manual patch section to README

  Show description for deb2adc
  LiyuanLucasLiu

  authored
  deb2adc

  Copy full SHA for deb2adc

Commits on Sep 14, 2025

• skip the patch of logprob compute for vllm 0.10.1 and upper

  LiyuanLucasLiu

  committed
  4d84681

  Copy full SHA for 4d84681

Commits on Sep 1, 2025

• Update README with hybrid rollout generation instructions

  LiyuanLucasLiu

  authored
  07f3c21

  Copy full SHA for 07f3c21

Commits on Aug 30, 2025

• added fast process alert

  LiyuanLucasLiu

  committed
  1c53561

  Copy full SHA for 1c53561

Commits on Aug 29, 2025

• Merge pull request #30 from yaof20/lucas/fix_fp8_bug

  Show description for b10c17c
  LiyuanLucasLiu

  authored
  b10c17c

  Copy full SHA for b10c17c

• added release note

  LiyuanLucasLiu

  committed
  71605b3

  Copy full SHA for 71605b3

• typo fixed

  LiyuanLucasLiu

  committed
  e106f85

  Copy full SHA for e106f85

• hot fix on vllm fp8 for weight_scale update skipping

  LiyuanLucasLiu

  committed
  24b1102

  Copy full SHA for 24b1102

Commits on Aug 27, 2025

• Update README with quantization recommendations

  LiyuanLucasLiu

  authored
  55f0c7b

  Copy full SHA for 55f0c7b

Commits on Aug 25, 2025

• Merge pull request #25 from yaof20/lucas/fast_8bit

  Show description for 1913572
  LiyuanLucasLiu

  authored
  1913572

  Copy full SHA for 1913572

• fixing

  LiyuanLucasLiu

  committed
  41d9080

  Copy full SHA for 41d9080

• Merge branch 'main' into lucas/fast_fp8_v2

  LiyuanLucasLiu

  committed
  8543afe

  Copy full SHA for 8543afe

• removed some assert

  LiyuanLucasLiu

  committed
  b3599c0

  Copy full SHA for b3599c0

• Merge pull request #24 from SumanthRH/skyrl-changes

  Show description for 1a17045
  LiyuanLucasLiu

  authored
  1a17045

  Copy full SHA for 1a17045

• replaced_lambda_function

  LiyuanLucasLiu

  committed
  3e4eb53

  Copy full SHA for 3e4eb53

• fixing

  LiyuanLucasLiu

  committed
  cc798b2

  Copy full SHA for cc798b2

Commits on Aug 24, 2025

• removed time

  LiyuanLucasLiu

  committed
  bd5577a

  Copy full SHA for bd5577a

• added fast_int8

  LiyuanLucasLiu

  committed
  ba1b5d0

  Copy full SHA for ba1b5d0

• added fast_int8

  LiyuanLucasLiu

  committed
  77b65bf

  Copy full SHA for 77b65bf

• adding logging

  LiyuanLucasLiu

  committed
  6011316

  Copy full SHA for 6011316

• v2.5

  LiyuanLucasLiu

  committed
  fc4a978

  Copy full SHA for fc4a978

Pagination

Previous

Next