Skip to content

Pull requests: open-compass/VLMEvalKit

New pull request New
45 Open 942 Closed
45 Open 942 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add BGPT REFUTE benchmark
#1569 opened Jun 5, 2026 by connerlambden Loading…
1
[Feature] Support DiffSpot (fine-grained visual change detection on web UIs)
#1568 opened Jun 4, 2026 by banyinjushi Loading…
3 tasks done
1
[Feature] Add Rebellions (RBLN) NPU evaluation backend
#1566 opened Jun 2, 2026 by rebel-hwkim Loading…
[Feature] Add MiniMax-M3 model and set as default
#1565 opened Jun 1, 2026 by octo-patch Contributor Loading…
3 tasks done
[Benchmark] Add support for MaRVL, xGQA and ALM-Bench
#1564 opened Jun 1, 2026 by inakiLakunza Contributor Loading…
[Benchmark]Add TextHalu-Bench
#1561 opened May 31, 2026 by Sammy20207109 Loading…
[Fix] Restore missing commas in extract_characters_regex prefix list
#1560 opened May 30, 2026 by YoungZSh Loading…
Handle recoverable truncated image payloads
#1554 opened May 25, 2026 by rajantripathi Loading…
1
[Fix] Match verbose Chain-of-Thought in eval
#1552 opened May 21, 2026 by ptonso Loading…
[Fix] Video-MME-v2: improve acc calculation and data preparation
#1551 opened May 20, 2026 by EliYuan30 Loading…
fix: guard choices[0] and message=None before content access
#1550 opened May 17, 2026 by qizwiz Loading…
[Cleanup] Remove unused Polygon3 dependency (#1528)
#1548 opened May 16, 2026 by SHAI-Akshay-Tripathi Contributor Loading…
1
[Benchmark] Add Spatial-DISE benchmark
#1542 opened May 9, 2026 by shinmohuang Loading…
[Fix] Fix default judge model selection conflict in run.py and tools.py
#1532 opened May 6, 2026 by TianhaoLiang2000 Collaborator Loading…
1
[Fix] Fix judge intermediate result caching and resume support
#1531 opened May 6, 2026 by TianhaoLiang2000 Collaborator Loading…
[Benchmark] Add support for MMOral-Uni benchmark
#1527 opened Apr 26, 2026 by isjinghao Contributor Loading…
5
[Benchmark] Add support for ReVSI Benchmark
#1526 opened Apr 25, 2026 by eamonn-zh Loading…
[Benchmark] Add support for Ref-L4_test benchmark
#1525 opened Apr 22, 2026 by rshube Loading…
[Benchmark] Add support for RefCOCO-M benchmark
#1524 opened Apr 22, 2026 by rshube Loading…
[Benchmark] Add support for PixmoPoints benchmark
#1523 opened Apr 22, 2026 by rshube Loading…
[Benchmark] Add support for PixmoCount benchmark
#1522 opened Apr 22, 2026 by rshube Loading…
Feat/concurrent dispatch
#1514 opened Apr 15, 2026 by Bluear7878 Loading…
Add LICA-Bench dataset (graphic design VLM evaluation)
#1513 opened Apr 15, 2026 by purvanshi Loading…
1 task
1
[Benchmark] Add Support for LVOmniBench
#1510 opened Apr 9, 2026 by KD-TAO Loading…
[Benchmark] Add support for MaXM
#1505 opened Apr 2, 2026 by inigopm Contributor Loading…
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.