Skip to content

Pull requests: NVIDIA-NeMo/Evaluator

New pull request New
16 Open 962 Closed
16 Open 962 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

experimental(slurm): add eval_ray_cluster multi-node bootstrap for agentic Gym evals nemo-evaluator-launcher tests
#1016 opened May 15, 2026 by agronskiy Collaborator Loading…
ci: add GitLab container build config for dev/0.3.0 (public containers)
#1015 opened May 14, 2026 by wprazuch Contributor Loading…
2
feat: harden NVCF endpoint handling documentation Improvements or additions to documentation nemo-evaluator nemo-evaluator-launcher tests
#1008 opened May 12, 2026 by manojkilaru97 Loading…
1
ci: Ensure bump branch is created first for dependabot CI
#1005 opened May 11, 2026 by chtruong814 Contributor Loading…
chore(beep boop 🤖): Bump uv.lock (main) (2026-05-11) nemo-evaluator nemo-evaluator-launcher
#1004 opened May 11, 2026 by svcnvidia-nemo-ci Contributor Loading…
1 task
feat: add ATIF retrieved context metric documentation Improvements or additions to documentation tests
#982 opened May 6, 2026 by SandyChapman • Draft
2
feat(launcher): per-task deployment_overrides nemo-evaluator-launcher tests
#973 opened May 5, 2026 by AdamRajfer Contributor Loading…
1
ci: Major refactor of release-workflows CI
#962 opened May 5, 2026 by ko3n1g Collaborator Loading…
3 tasks
3
Add ExactMatch Metric scorer PoC tests
#961 opened May 4, 2026 by SandyChapman • Draft
3
feat(byob): port multiple-choice loglikelihood + few-shot onto shared metric contract scripts tests
#955 opened May 4, 2026 by wprazuch Contributor • Draft
5 of 7 tasks
2
feat: add shared metric contract for scorer functions tests
#950 opened Apr 29, 2026 by SandyChapman Loading…
8
feat(tasks): Add RASB 26H1 evaluator integration CI community-request documentation Improvements or additions to documentation nemo-evaluator nemo-evaluator-launcher tests waiting-on-customer Waiting on the original author to respond
#943 opened Apr 27, 2026 by pbelcak Loading…
3
chore(beep boop 🤖): Bump uv.lock (main) (2026-04-27) nemo-evaluator nemo-evaluator-launcher
#941 opened Apr 27, 2026 by svcnvidia-nemo-ci Contributor Loading…
1 task
fix(slurm): request zero GPUs when export falls back to GPU partition nemo-evaluator-launcher
#915 opened Apr 17, 2026 by AdamRajfer Contributor Loading…
feat: add generic heartbeat for periodic script execution during evaluation documentation Improvements or additions to documentation nemo-evaluator-launcher tests
#876 opened Mar 20, 2026 by AdamRajfer Contributor Loading…
4 tasks done
@AdamRajfer
8
feat: add local no-docker mode for nemo-evaluator-launcher community-request documentation Improvements or additions to documentation nemo-evaluator-launcher tests waiting-on-customer Waiting on the original author to respond
#786 opened Mar 1, 2026 by mishana Loading…
@prokotg
26
ProTip! Updated in the last three days: updated:>2026-05-14.