Search results

chore(providers): update lighteval benchmark metric names in provider definitions

Status: Open.

#596 In eval-hub/eval-hub;

· ruivieira opened on May 22, 2026

Provider pod uses hardcoded unqualified sidecar image eval-runtime-sidecar:latest instead of configured value

Status: Open.

#574 In eval-hub/eval-hub;

· jeremyeder opened on May 13, 2026

Document RHOAI MLflow API authentication pattern

Status: Open.

#550 In eval-hub/eval-hub;

· jeremyeder opened on May 7, 2026

Add MLflow tracing for EvalHub adapter LLM calls

Status: Open.

#549 In eval-hub/eval-hub;

· jeremyeder opened on May 7, 2026

RFE: EvalHub should support per-job environment variable injection into benchmark pods

Status: Open.

#548 In eval-hub/eval-hub;

· jeremyeder opened on May 7, 2026

RFE: EvalHub should support volume mounts in provider spec

Status: Open.

#547 In eval-hub/eval-hub;

· jeremyeder opened on May 7, 2026

RFE: EvalHub should forward job parameters to benchmark pods

Status: Open.

Feature

#546 In eval-hub/eval-hub;

· jeremyeder opened on May 7, 2026

fix: stale version-matrix from the COMPATIBILITY.md

kind/fixCategorizes issue as a bug fixCategorizes issue as a bug fix

status/triageNeeds initial review and prioritizationNeeds initial review and prioritization

Status: Open.

#529 In eval-hub/eval-hub;

· kami619 opened on May 4, 2026

feat: make Job backoffLimit configurable

kind/featCategorizes issue as a feature requestCategorizes issue as a feature request

status/triageNeeds initial review and prioritizationNeeds initial review and prioritization

Status: Open.

#424 In eval-hub/eval-hub;

· saichandrapandraju opened on Apr 3, 2026

[bug]: sidecar not terminating in case of adapter pod failure

kind/fixCategorizes issue as a bug fixCategorizes issue as a bug fix

status/triageNeeds initial review and prioritizationNeeds initial review and prioritization

Status: Open.

#423 In eval-hub/eval-hub;

· saichandrapandraju opened on Apr 3, 2026

[Feature]: Support multiple models with separate API keys in a single evaluation workflow

kind/featCategorizes issue as a feature requestCategorizes issue as a feature request

status/triageNeeds initial review and prioritizationNeeds initial review and prioritization

Status: Open.

#242 In eval-hub/eval-hub;

· saichandrapandraju opened on Feb 26, 2026