Skip to content

Pull requests: openai/evals

New pull request New
Clear current search query, filters, and sorts
23 Open 222 Closed
23 Open 222 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Extending to Azure OpenAI implementation
#1470 opened Feb 23, 2024 by pkt1583 Loading…
7
Add **kwargs to OpenAIChatCompletionFn
#1494 opened Mar 15, 2024 by ezraporter Loading…
1
1
[Evals] Add eval for Dhivehi diacritical marks
#1495 opened Mar 16, 2024 by aanaseer Loading…
11 of 12 tasks
1
Fix specifying API arguments from the CLI
#1505 opened Mar 27, 2024 by LoryPack Contributor Loading…
6 tasks done
1
Update custom-eval.md
#1598 opened Aug 19, 2025 by rajeshkp Loading…
13 tasks
Update to python 3.12
#1607 opened Dec 21, 2025 by omonimus1 Loading…
1
Add powershell-encoding-basics eval
#1611 opened Jan 28, 2026 by TheodorNEngoy Loading…
Refactor JSONL file loading logic in data.py
#1612 opened Feb 3, 2026 by Pritiks23 Loading…
13 tasks done
Pritiks23 patch 1
#1613 opened Feb 3, 2026 by Pritiks23 Loading…
13 tasks done
Add reasoning consistency eval under constrained intermediate steps
#1615 opened Feb 5, 2026 by getappai Loading…
Improving CI
#1617 opened Feb 5, 2026 by fsdavi Loading…
13 tasks
fix: correct typos in evals
#1621 opened Feb 7, 2026 by thecaptain789 Loading…
Add Logic Stress Stress-test Suite (v2, v3)
#1622 opened Feb 16, 2026 by 14H034160212 Contributor Loading…
README: fix Evals starter guide link
#1623 opened Feb 19, 2026 by dcol91863 Loading…
1
Add finance-agent routing eval dataset and builder guidance
#1625 opened Feb 24, 2026 by maxpetrusenko Loading…
eval: add RAIL Score responsible AI evaluation across 8 dimensions
#1640 opened Apr 2, 2026 by SumitVermakgp Loading…
12 tasks done
Add Turkish language evals: logical reasoning and grammar
#1647 opened Apr 23, 2026 by kayametehan Loading…
7
Update Python version to 3.12 and refresh PR template
#1648 opened Apr 23, 2026 by kayametehan Loading…
2
2
Add Turkish proverbs eval
#1649 opened Apr 23, 2026 by kayametehan Loading…
5
Handle nested token usage details in oaieval
#1650 opened Apr 23, 2026 by kayametehan Loading…
1
1
Route modern OpenAI models through chat completions
#1651 opened Apr 23, 2026 by kayametehan Loading…
1
1
Add explain mode to HumanCliSolver
#1652 opened Apr 23, 2026 by kayametehan Loading…
1
4
Fix OpenAI completion args routing
#1653 opened Apr 23, 2026 by kayametehan Loading…
1
1
ProTip! Updated in the last three days: updated:>2026-04-25.