Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Jan 3, 2024

• Fix argument parsing in examples/batched (#113)

  hodlen

  authored
  c2cfbf4

  Copy full SHA for c2cfbf4

Commits on Dec 29, 2023

• Support setting VRAM budget for `examples/server` (#106)

  Show description for 74c5c58
  hodlen

  authored
  74c5c58

  Copy full SHA for 74c5c58

Commits on Dec 20, 2023

• Online GPU slicing (#11)

  Show description for bb486b8
  hodlen

  authored
  bb486b8

  Copy full SHA for bb486b8

Commits on Dec 15, 2023

• add gpu index opts and udpate doc commands (#2)

  hodlen

  authored
  66a1bb4

  Copy full SHA for 66a1bb4

Commits on Dec 12, 2023

• merge PowerInfer impl from the internal codebase

  hodlen

  committed
  a3c295a

  Copy full SHA for a3c295a

Commits on Nov 13, 2023

• llava : fix regression for square images in #3613 (#4056)

  monatis

  authored
  bd90eca

  Copy full SHA for bd90eca

• sync : ggml (backend v2) (#3912)

  Show description for 4760e7c
  ggerganov

  authored
  4760e7c

  Copy full SHA for 4760e7c

Commits on Nov 12, 2023

• Fix some documentation typos/grammar mistakes (#4032)

  Show description for 532dd74
  

  richardkiss

  and

  KerfuffleV2

  authored
  532dd74

  Copy full SHA for 532dd74

Commits on Nov 11, 2023

• server : fix crash when prompt exceeds context size (#3996)

  z80maniac

  authored
  d96ca7d

  Copy full SHA for d96ca7d

• gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981)

  Show description for 34b0a08
  

  KerfuffleV2

  and

  cebtenzzre

  authored
  34b0a08

  Copy full SHA for 34b0a08

Commits on Nov 10, 2023

• server : allow continue edit on completion mode (#3950)

  Show description for 4a4fd3e
  jhen0409

  authored
  4a4fd3e

  Copy full SHA for 4a4fd3e

Commits on Nov 9, 2023

• server : add min_p param (#3877)

  Show description for 57ad015
  Mihaiii

  authored
  57ad015

  Copy full SHA for 57ad015

Commits on Nov 7, 2023

• ggml : fix backward rope after YaRN (#3974)

  Show description for e9c1cec
  xaedes

  authored
  e9c1cec

  Copy full SHA for e9c1cec

• Use params when loading models in llava-cli (#3976)

  Show description for 54b4df8
  tejom

  authored
  54b4df8

  Copy full SHA for 54b4df8

Commits on Nov 6, 2023

• llava : expose as a shared library for downstream projects (#3613)

  Show description for 381efbf
  

  3 peopleauthored
  381efbf

  Copy full SHA for 381efbf

Commits on Nov 5, 2023

• server : fix typo for --alias shortcut from -m to -a (#3958)

  hoangtamthai

  authored
  bb60fd0

  Copy full SHA for bb60fd0

Commits on Nov 3, 2023

• speculative : change default p_accept to 0.5 + CLI args (#3919)

  Show description for 8f961ab
  ggerganov

  committed
  8f961ab

  Copy full SHA for 8f961ab

Commits on Nov 2, 2023

• build : link against build info instead of compiling against it (#3879)

  Show description for b12fa0d
  

  cebtenzzre

  and

  kassane

  authored
  b12fa0d

  Copy full SHA for b12fa0d

Commits on Nov 1, 2023

• llama : implement YaRN RoPE scaling (#2268)

  Show description for 898aeca
  

  cebtenzzre

  and

  jquesnelle

  authored
  898aeca

  Copy full SHA for 898aeca

• finetune : add -ngl parameter (#3762)

  Show description for 73bdcb3
  

  3 peopleauthored
  73bdcb3

  Copy full SHA for 73bdcb3

• server : re-enable completion and embedded at the same time (#3876)

  a-h

  authored
  ca190bc

  Copy full SHA for ca190bc

Commits on Oct 31, 2023

• samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841)

  Show description for 238657d
  

  3 peopleauthored
  238657d

  Copy full SHA for 238657d

Commits on Oct 29, 2023

• Extend llama_kv_cache_seq_rm to allow matching any sequence (#3843)

  Show description for 6e08281
  KerfuffleV2

  authored
  6e08281

  Copy full SHA for 6e08281

• ggml : quantization refactoring (#3833)

  Show description for d69d777
  

  ggerganov

  and

  cebtenzzre

  authored
  d69d777

  Copy full SHA for d69d777

Commits on Oct 28, 2023

• llama : add option for greedy sampling with probs (#3813)

  Show description for ee1a0ec
  ggerganov

  authored
  ee1a0ec

  Copy full SHA for ee1a0ec

Commits on Oct 27, 2023

• speculative : ensure draft and target model vocab matches (#3812)

  Show description for 41aee4d
  KerfuffleV2

  authored
  41aee4d

  Copy full SHA for 41aee4d

• simple : fix batch handling (#3803)

  tterrasson

  authored
  c8d6a1f

  Copy full SHA for c8d6a1f

Commits on Oct 26, 2023

• server : do not release slot on image input (#3798)

  ggerganov

  committed
  34b2a5e

  Copy full SHA for 34b2a5e

Commits on Oct 25, 2023

• batched-bench : print params at start

  ggerganov

  committed
  6961c4b

  Copy full SHA for 6961c4b

Commits on Oct 24, 2023

• server : add parameter -tb N, --threads-batch N (#3584) (#3768)

  Show description for ad93962
  

  3 peopleauthored
  ad93962

  Copy full SHA for ad93962

• server : do not block system prompt update (#3767)

  Show description for 1717521
  ggerganov

  authored
  1717521

  Copy full SHA for 1717521

• cmake : add missed dependencies (#3763)

  kingsidelee

  authored
  abd21fc

  Copy full SHA for abd21fc

• cuda : add batched cuBLAS GEMM for faster attention (#3749)

  Show description for 2b4ea35
  

  ggerganov

  and

  KerfuffleV2

  authored
  2b4ea35

  Copy full SHA for 2b4ea35

Commits on Oct 23, 2023

• llama : remove token functions with `context` args in favor of `model` (#3720)

  Show description for 5be6c80
  

  MarcusDunn

  and

  ggerganov

  authored
  5be6c80

  Copy full SHA for 5be6c80

Commits on Oct 22, 2023

• server : parallel decoding and multimodal (#3677)

  Show description for 438c2ca
  

  5 peopleauthored
  438c2ca

  Copy full SHA for 438c2ca