Search results

Cluster-scale serving replication

Status: Open.

#24 In infinigence/Semi-PD;

· sudokara opened on Jan 13, 2026

A plan of comiting to SGLANG

Status: Open.

#23 In infinigence/Semi-PD;

· ttaohe opened on Aug 15, 2025

TTFT Not as Expected – How to Reproduce? (Based on Official Evaluation Criteria)

Status: Open.

#20 In infinigence/Semi-PD;

· yansiyu550 opened on May 23, 2025

allocation of request

Status: Open.

#19 In infinigence/Semi-PD;

· Nicole-ying opened on May 21, 2025

[Bug] memory leak

Status: Open.

#17 In infinigence/Semi-PD;

· miter6 opened on May 14, 2025

process rotation mechanism

Status: Open.

#16 In infinigence/Semi-PD;

· Nicole-ying opened on May 12, 2025

[Performance] Semi-PD does not improve performance over Sglang 0.4.4 on RTX 4090 setups

Status: Open.

#14 In infinigence/Semi-PD;

· yansiyu550 opened on May 9, 2025