All pull requests

Pull requests

• fix(python): honor explicit None in partial scorers

  #267·Vinsy Moyya (vinsymoyya) opened Nov 5, 2026·

  ·
  1

• fix: Python CoT suffix says "step-by-step manner", as in JS

  #265·Abhay Mettu (abhaymettu) opened Nov 4, 2026·

  ·
  1

• fix(python): honor classifier spec option overrides

  #264·joo00der (jihtsan) opened Nov 2, 2026·

  ·
  1

  1

• fix(json): distinguish absent object members from null

  #263·joo00der (jihtsan) opened Nov 2, 2026·

  ·
  1

  1

• feat: add DrexClassifier, a Drex decision-model scorer (Python and TypeScript)

  #260·akzholai opened Nov 2, 2026·

  ·

• fix(python): await custom scorers in JSONDiff async evaluations

  #258·Bin (xlb3055) opened Oct 28, 2026·

  ·

• fix: isolate embedding cache by default client

  #257·Jacqueline122 opened Oct 27, 2026·

  ·
  1

• fix: replace the gpt-5-mini runtime default model before OpenAI retires it

  #255·alexcastgonz (pcbeingused333) opened Oct 27, 2026·

  ·

• fix(python): do not send a default temperature from AnswerRelevancy

  #254·alexcastgonz (pcbeingused333) opened Oct 22, 2026·

  ·
  1

• docs: describe NumericDiff as it works

  #252·berce (bercedev) opened Oct 22, 2026·

  ·
  1

• fix: honor partial pairwise scorers in Python ListContains

  #250·BSAIPF opened Oct 21, 2026·

  ·

• fix: allow explicit thread render overrides

  #247·Aryan R. Ganjoo (AryanRG) opened Oct 16, 2026·

  ·

• fix(ragas): join list contexts in Faithfulness before judging

  #246·Yuriy H (jurayh) opened Oct 10, 2026·

  ·

• fix(ragas): score 0 when AnswerCorrectness classification is empty

  #245·Yuriy H (jurayh) opened Oct 8, 2026·

  ·

• feat: add voice task success scorer

  #241·kev (kevchoi) opened Oct 7, 2026·1/3·

  ·
  1

• feat: add speech clarity audio scorer

  #239·kev (kevchoi) opened Oct 7, 2026·3/3·

  ·
  1

• feat: add voice latency and interruptions scorers

  #238·kev (kevchoi) opened Oct 7, 2026·2/3·

  ·
  1

• fix: avoid overflow in NumericDiff for finite inputs

  #237·Deepanshu Pal (deepanshupal) opened Oct 7, 2026·

  ·

• fix: upgrade anyio to 4.14.2 (CVE-2026-63374)

  #236·Anupam Mediratta (anupamme) opened Oct 5, 2026·

  ·

• harden: add path validation in sync_datasets.ts

  #235·Anupam Mediratta (anupamme) opened Oct 5, 2026·

  ·

• Ship a PEP 561 py.typed marker for the Python package

  #234·Adam Hitchcock (NorthIsUp) opened Oct 3, 2026·

  ·
  1

• fix(ragas): score empty retrieval contexts as zero

  #231·Silu Panda (SiluPanda) opened Oct 2, 2026Contributor·

  ·
  1

• Stop HTML-escaping scorer values in the ragas prompts

  #227·Chen Yufeiyang (feiiiiii5) opened Sep 28, 2026·

  ·
  2

• fix(ragas): resolve the judge model through the library default

  #226·Chen Yufeiyang (feiiiiii5) opened Sep 28, 2026·

  ·
  1

• fix(ragas): score 0 when Faithfulness gets no statements

  #225·Chen Yufeiyang (feiiiiii5) opened Sep 28, 2026·

  ·
  1