All pull requests

Pull requests

• fix: apply output_config.effort on /v1/messages

  #634·goodbadwolf opened Oct 13, 2026·

  ·
  1

• Add MiniCPM-V 4.7 adapter and forward canvas attention arguments

  #633·shiftedx opened Oct 13, 2026Contributor·

  ·

• Leave Gemma 4 attention out of the generic SDPA hook

  #632·jvmenen opened Oct 13, 2026Contributor·

  ·

• Say why a request found nothing to reuse, and stop labelling normal misses as an SSD fault

  #631·jvmenen opened Oct 13, 2026Contributor·

  ·

• Segmented KV on Macs without tensor units (M1-M4): per-segment attention with a logsumexp merge

  #630·jvmenen opened Oct 13, 2026Contributor·

  ·

• Cut per-turn host cost of prefix lookups (cold-tier scan, prompt conversion, RAM compares)

  #629·jvmenen opened Oct 13, 2026Contributor·

  ·

• Share one common_prefix_len and one reader per session-prefix setting

  #628·jvmenen opened Oct 13, 2026Contributor·

  ·

• Dashboard: show time and tok/s at the cursor on the decode chart

  #626·jvmenen opened Oct 13, 2026Contributor·

  ·

• Run the fixed-M4 stage-3 lane for q2/g64 routed experts

  #625·trustos opened Oct 12, 2026·

  ·

• Dashboard: show what the server really runs with on the Settings tab

  #623·jvmenen opened Oct 11, 2026Contributor·

  ·

• Dashboard: show what is cached in RAM and on SSD instead of empty slot cards

  #622·jvmenen opened Oct 11, 2026Contributor·

  ·

• Keep an unwritten idle conversation through a WARNING pressure trim

  #620·jvmenen opened Oct 10, 2026Contributor·

  ·

• one_copy: fall back to copying when a QSA resize would cut held bank rows

  #619·oliverlavery opened Oct 10, 2026·

  ·

• Write an idle conversation to SSD before the admission releases it

  #618·jvmenen opened Oct 10, 2026Contributor·

  ·

• Show the waits before a request's work in the flight log and the dashboard

  #617·jvmenen opened Oct 10, 2026Contributor·

  ·

• Update mlx-lm requirement from <0.32,>=0.31 to >=0.31,<0.33

  dependenciespython
  #615·dependabot[bot] opened Oct 10, 2026Bot·

  ·

• Update transformers requirement from !=5.13.0,<5.17,>=5.10.0 to >=5.10.0,!=5.13.0,<5.20

  dependenciespython
  #614·dependabot[bot] opened Oct 10, 2026Bot·

  ·

• Bump actions/download-artifact from 8.0.1 to 8.0.2

  dependenciesgithub_actions
  #613·dependabot[bot] opened Oct 10, 2026Bot·

  ·

• Bump actions/upload-artifact from 7.0.1 to 7.0.2

  dependenciesgithub_actions
  #612·dependabot[bot] opened Oct 10, 2026Bot·

  ·

• Segmented KV cache: follow-up turns, forks and restores without copying the history (MTPLX_SEGMENTED_KV)

  #610·jvmenen opened Oct 9, 2026Contributor·

  ·

• Restore an evicted session from SSD, and release near-prefix candidates the lane does not keep

  #609·jvmenen opened Oct 9, 2026Contributor·

  ·
  1

• SSD restore builds the request's cache layout

  #608·jvmenen opened Oct 9, 2026Contributor·

  ·

• Prefill rungs carry the GDN states: lower memory peak on hybrid models (MTPLX_PREFILL_ASYNC_RUNGS_STATES, opt-in)

  #607·jvmenen opened Oct 9, 2026Contributor·

  ·

• Take Claude Code's X-Claude-Code-Session-Id as the session id

  #606·jvmenen opened Oct 9, 2026Contributor·

  ·

• Dashboard: show refused requests as refusals in the request log

  #600·jvmenen opened Oct 6, 2026Contributor·

  ·