Skip to content

Pull requests: Aleph-Alpha-Research/eval-framework

New pull request New
27 Open 376 Closed
27 Open 376 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix(deps): update dependency numpy to >=2.5.0
#410 opened Jun 25, 2026 by aar-public-version-bump-bot Bot Loading…
1 task
1
fix: fix bugs in new SQUAD ma task
#408 opened Jun 24, 2026 by AuguB Contributor Loading…
fix(deps): update dependency openai to >=1.109.1,<3
#397 opened Jun 23, 2026 by aar-public-version-bump-bot Bot Loading…
1 task
refactor!: implement task naming convention
#379 opened Jun 19, 2026 by fsschneider Collaborator • Draft
7 of 9 tasks
chore: release v1.0.0
#375 opened Jun 18, 2026 by martinreinhardt01 Collaborator Loading…
12 tasks
chore: manual upgrade of hf ecosystem packages
#362 opened Jun 13, 2026 by prabhuteja12 Collaborator • Draft
12 tasks
fix: do not include language consistency metric results for empty completions
#343 opened Jun 5, 2026 by MaxHam Contributor Loading…
chore(deps): lock file maintenance
#342 opened Jun 5, 2026 by aar-public-version-bump-bot Bot Loading…
1 task
fix(deps): update dependency huggingface-hub to v1
#339 opened Jun 5, 2026 by aar-public-version-bump-bot Bot Loading…
1 task
3
fix(deps): update dependency sympy to >=1.14.0,<2
#338 opened Jun 5, 2026 by aar-public-version-bump-bot Bot Loading…
1 task
3
chore(deps): update python to v3.14.5
#337 opened Jun 5, 2026 by aar-public-version-bump-bot Bot Loading…
1 task
2
fix(deps): update dependency boto3 to >=1.43.23,<2
#335 opened Jun 5, 2026 by aar-public-version-bump-bot Bot Loading…
1 task
2
fix(deps): update dependency transformers to v5 [security]
#332 opened Jun 5, 2026 by aar-public-version-bump-bot Bot Loading…
1 task
3
fix(deps): update dependency openai to >=2.41.0,<3
#286 opened Jun 1, 2026 by aar-public-version-bump-bot Bot Loading…
1 task
2
refactor: Make linter stricter
#233 opened May 7, 2026 by martinreinhardt01 Collaborator Loading…
12 tasks
fix: minerva sympy memory limit
#223 opened Apr 20, 2026 by prabhuteja12 Collaborator • Draft
4 of 12 tasks
feat: bpb implementations
#212 opened Apr 9, 2026 by prabhuteja12 Collaborator Loading…
12 tasks
Update citation year and add version+author to README
#159 opened Jan 26, 2026 by tfburns Collaborator Loading…
1 task done
chore: Bump pyasn1 from 0.6.1 to 0.6.2 in the uv group across 1 directory dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code
#157 opened Jan 16, 2026 by dependabot Bot Loading…
feat: add safe_metric_calculation decorator for LLM judge error handling
#154 opened Jan 13, 2026 by AhmedHammam-AA Collaborator Loading…
docs: add LLM as judge guide
#151 opened Jan 12, 2026 by AhmedHammam-AA Collaborator Loading…
2
fix(main): duplicated task that are actually the same
#144 opened Jan 7, 2026 by benureau Loading…
3 of 13 tasks
fix(wmt): use HuggingFace datasets instead of sacrebleu
#137 opened Dec 19, 2025 by AhmedHammam-AA Collaborator Loading…
2
Remove leading space in ground truth formatting
#129 opened Dec 10, 2025 by SohirMaskey Loading…
3 of 13 tasks
harcoded date for consistent evals
#99 opened Nov 4, 2025 by GrS-AA Collaborator • Draft
13 tasks
4
ProTip! Exclude everything labeled bug with -label:bug.