Issues

• bpref returns NaN for qrels with no judged non-relevant docs (trec_eval returns a defined value), and fisher_randomization_test reports p_value=0.0 / significant=True whenever a per-query score is NaN

  AmenRa/ranx#85 · Filter by author shaurya416 opened on Sep 26, 2026

• evaluate() pairs dict qrels and run by key insertion order, not by query id; a perfect run can score 0.0

  AmenRa/ranx#84 · Filter by author shaurya416 opened on Sep 26, 2026

• Proposal: standalone ranx-openeval-adapter (Qrels/Run/per-query metric arrays <-> EvalPort Suite/ResultSet)

  AmenRa/ranx#82 · Filter by author adhabnr-ux opened on Sep 22, 2026

• [BUG] Pandas 3 support

  bug
  AmenRa/ranx#79 · Filter by author cmacdonald opened on Feb 2, 2026

• [Feature Request] Make Numba Optional with Pure NumPy Fallbacks

  enhancement
  AmenRa/ranx#75 · Filter by author diegoceccarelli opened on Aug 6, 2025
  4

• [BUG] Crash when trying to make a Run comparable if numba JIT is disabled

  bug
  AmenRa/ranx#74 · Filter by author milyenpabo opened on Jul 9, 2025
  10

• [Feature Request] Support for non-integer relevance labels

  enhancement
  AmenRa/ranx#71 · Filter by author davefernig opened on Jan 24, 2025
  1

• Fisher's Randomization Test yields nondeterministic results

  bug
  AmenRa/ranx#70 · Filter by author marianrh opened on Nov 21, 2024

• [BUG] Run with one empty results error

  bug
  AmenRa/ranx#67 · Filter by author tungnt55 opened on Sep 4, 2024

• JIT compilation on serverless (i.e. Modal Labs)

  help wanted
  AmenRa/ranx#64 · Filter by author andersonbcdefg opened on Mar 13, 2024
  2

• How do we compare different runs with multiple folds per run?

  AmenRa/ranx#60 · Filter by author celsofranssa opened on Jan 17, 2024
  1

• [Feature Request] Propensity-scored Metrics

  enhancement
  AmenRa/ranx#59 · Filter by author celsofranssa opened on Dec 4, 2023
  4

• Spearman, Kendall correlation functions

  enhancement
  AmenRa/ranx#20 · Filter by author ivan-savchuk opened on Jul 21, 2022
  7