Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: vllm-project/vllm
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: Sibble-AI/vllm
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: main
Choose a head ref
  • 4 commits
  • 4 files changed
  • 1 contributor

Commits on Oct 30, 2024

  1. speculative decoding script

    @philipchu
    philipchu committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    6793f7f View commit details
    Browse the repository at this point in the history

  2. adding shared prefill script

    @philipchu
    philipchu committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    97a0863 View commit details
    Browse the repository at this point in the history

  3. added util.py, shared prefix increasing input speed by 25%

    @philipchu
    philipchu committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    c261079 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. utilizing priority batching in vllm

    @philipchu
    philipchu committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    0a5ce1d View commit details
    Browse the repository at this point in the history
Loading