-
Notifications
You must be signed in to change notification settings - Fork 639
Pull requests: EvolvingLMMs-Lab/lmms-eval
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
fix: carry full task ctx in auto doc_to_messages for text-only tasks (#1319)
#1431
opened Aug 12, 2026 by
lorenzozanee
Loading…
7 tasks
[Model] Add VQToken integration for LLaVA-OneVision
#1430
opened Aug 11, 2026 by
Hai-chao-Zhang
Loading…
3 of 7 tasks
fix(vllm): preserve per-request sampling parameters
#1428
opened Aug 9, 2026 by
turturturturtur
Contributor
Loading…
feat(tasks): add owner-aligned MicroVQA benchmark
#1427
opened Aug 9, 2026 by
turturturturtur
Contributor
Loading…
fix(openai): preserve per-request sampling parameters
#1426
opened Aug 9, 2026 by
turturturturtur
Contributor
Loading…
feat: add agentic game-loop evaluation (generate_until_game)
#1418
opened Jul 31, 2026 by
Luodian
Contributor
•
1/2
Loading…
4 of 7 tasks
fix(distributed): call destroy_process_group() on exit to prevent NCC…
#1391
opened Jul 6, 2026 by
mandanajignesh-byte
Contributor
Loading…
7 tasks
Add Qwen-native JSON coordinate variants for pointing tasks
#1361
opened Jun 5, 2026 by
njb-nvidia
Contributor
Loading…
fix: guard choices[0] and message=None before content access (41 sites, 32 files)
#1332
opened May 17, 2026 by
qizwiz
Loading…
Fix missing Task import for type annotation in evaluator
#1291
opened Apr 10, 2026 by
luv-oct22
Loading…
2 tasks
feat: add physics reasoning benchmarks (PhysBench, ContPhy, PhysGame, PhysicsRW, PhysReason)
#1272
opened Mar 26, 2026 by
Luodian
Contributor
Loading…
4 tasks
feat: add VBench video generation evaluation benchmark
#1271
opened Mar 26, 2026 by
Luodian
Contributor
Loading…
3 tasks
feat: add MiniMax as LLM judge provider (default model: MiniMax-M3)
#1263
opened Mar 22, 2026 by
octo-patch
Loading…
3 tasks done
ProTip!
Filter pull requests by the default branch with base:main.