Skip to content

Move free_gpu_memory_fraction under newly enforced kv_cache_config se…

2efa136
Select commit
Loading
Failed to load commit list.
Merged

fix: Update breaking change to enable_overlap_scheduler field from TRTLLM commit b4e5df0e #1310

Move free_gpu_memory_fraction under newly enforced kv_cache_config se…
2efa136
Select commit
Loading
Failed to load commit list.