All pull requests

Pull requests

• pr-set: update

  #336·danielhanchen opened Oct 29, 2026Member·

  ·

• llama : flag the outputs of every backend sampling chain

  #335·danielhanchen opened Oct 29, 2026Member·

  ·
  3

• model : DeepSeek-V4.1-Flash-1017 pin on upstream deepseek41 (MXFP8 Engram + extras)

  #332·danielhanchen opened Oct 27, 2026Member·

  ·
  4

• metal: add NVFP4 mul_mat, mul_mat_id and get_rows kernels

  #330·Lyxot opened Oct 27, 2026·

  ·
  5

• vulkan: copy a misaligned top_k input to an aligned scratch instead of aborting

  #328·danielhanchen opened Oct 26, 2026Member·

  ·
  6

• server: preserve speculative drafts across sub-batch retries

  #326·Imagineer99 opened Oct 25, 2026Member·

  ·
  1

• common : --fit grows the ubatch of MoE models into spare VRAM, for up to 2.5x faster prompt processing

  #321·LeoBorcherding opened Oct 23, 2026·

  ·
  2

  

• model: add MiniMax-M3.1

  #320·danielhanchen opened Oct 23, 2026Member·

  ·
  6

• model : project mamba1, plamo2 and minimax-01 inputs in 2-D before the per-sequence reshape

  #319·danielhanchen opened Oct 23, 2026Member·

  ·
  1

• model : Beam applies its attention-gate and FFN scales; converter loads the tokenizer on transformers 4.x

  #317·danielhanchen opened Oct 22, 2026Member·

  ·
  1

• sampling: backend samplers match the CPU samplers, also under draft verification; ggml-alloc re-plans when a tensor becomes an output

  #316·danielhanchen opened Oct 21, 2026Member·

  ·
  7

• CUDA: FA MMA in-kernel K/V dequant for all quantized K/V types, head dims 64/96/192 and MLA, and Turing

  #315·danielhanchen opened Oct 21, 2026Member·

  ·
  2

• Model arch: Flint

  #314·danielhanchen opened Oct 21, 2026Member·

  ·
  2

• ggml-backend, llama: drop most host syncs per decode step (async sched inputs, lazy getter syncs)

  #313·danielhanchen opened Oct 21, 2026Member·

  ·
  2

• chat : end Beam analysis on <|constrain|> header variants

  #311·danielhanchen opened Oct 21, 2026Member·

  ·
  9

• rpc : one send per message and an optional mutual TLS 1.3 transport

  #309·danielhanchen opened Oct 21, 2026Member·

  ·
  29

• pr-set: pin qwen4exp DFlash layer-input fix (#307)

  #308·danielhanchen opened Oct 21, 2026Member·

  ·
  1

• qwen4exp : give drafters the mean of the hyper-connection streams as layer input

  #307·danielhanchen opened Oct 21, 2026Member·

  ·
  1

  11

• pr-set: pin #303 (CUDA FA MMA in-kernel q4_0/q8_0 K/V dequant for 3-16 tokens)

  #306·danielhanchen opened Oct 21, 2026Member·

  ·
  3

• pr-set: pin CUDA IQ1_M MMQ (#304)

  #305·danielhanchen opened Oct 21, 2026Member·

  ·
  1

• CUDA: add IQ1_M to MMQ

  #304·danielhanchen opened Oct 21, 2026Member·

  ·
  5

• CUDA: dequantize q4_0/q8_0 K/V tiles in the FA MMA kernel for small multi-sequence batches (pin branch on b11642)

  #303·danielhanchen opened Oct 20, 2026Member·

  ·
  3

• mtmd : DeepSeek-V4.1-Flash vision (deepseek41v)

  #297·danielhanchen opened Oct 19, 2026Member·

  ·
  2

• model : deepseek41 DSpark speculative draft

  #296·danielhanchen opened Oct 19, 2026Member·

  ·
  3

• model : deepseek41 sparse attention, per-device KV mirrors, host gather

  #295·danielhanchen opened Oct 19, 2026Member·

  ·
  1