Skip to content

Pull requests: open-compass/opencompass

New pull request New
86 Open 1,271 Closed
86 Open 1,271 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Update] add raw prompt config for ruler, needlebench, longbenchv2, and babilong
#2474 opened Jun 5, 2026 by Myhs-phz Collaborator Loading…
add parameter "--no-progress" to not print detail logs when analyze repeat, by default behavior is print
#2473 opened Jun 5, 2026 by JifeiShan Loading…
@tonysy
Add BGPT REFUTE benchmark
#2471 opened Jun 5, 2026 by connerlambden Loading…
@tonysy
1
Add optional juryeval integration for LLM-as-Judge metrics
#2465 opened May 31, 2026 by py-ai-dev Loading…
@tonysy
[Dataset] Add ZebraLogic benchmark
#2464 opened May 31, 2026 by amanyara Loading…
3 tasks done
@tonysy
[Fix] Handle max_out_len=None in HuggingFace generation
#2459 opened May 24, 2026 by ziyangwang007 Loading…
1
@tonysy
[Dataset] Add ArxivRollBench
#2458 opened May 24, 2026 by liangzid Loading…
@tonysy
[Fix] Restore LongBench v2 answer prompt punctuation
#2452 opened May 15, 2026 by yhzhu99 Loading…
1
@tonysy
[Fix] Combine split eval results in default summarizer
#2451 opened May 15, 2026 by yhzhu99 Loading…
1
@tonysy
[Fix] Avoid scoring invalid SIQA generations as correct
#2450 opened May 15, 2026 by yhzhu99 Loading…
1
@tonysy
[Fix] Build ChatML mcq rule evaluator configs safely
#2449 opened May 15, 2026 by yhzhu99 Loading…
1
@tonysy
[Feature] Add BuySideFinBench dataset for buy-side financial analysis…
#2446 opened May 13, 2026 by cindy90 Loading…
5 tasks done
1
Add support for extra headers in Claude SDK API
#2445 opened May 8, 2026 by SongYippee Loading…
@tonysy
1
fix: handle dict output in SmolInstructDataset.load for SIDER subset
#2443 opened Apr 26, 2026 by octo-patch Loading…
1
@tonysy
feat: add LiteLLM as AI gateway model backend
#2441 opened Apr 22, 2026 by RheagalFire Loading…
4 of 6 tasks
2
fix: handle all test_range types in SizePartitioner.get_cost
#2438 opened Apr 20, 2026 by octo-patch Loading…
1
@bittersweet1999
[Fix] Use pre-tokenized prompts in VLLMwithChatTemplate to avoid modifying model input
#2434 opened Apr 15, 2026 by suhmily10 Loading…
1 of 2 tasks
[BugFix] Fix gsm8k postprocess
#2426 opened Mar 30, 2026 by Hibbert133 Loading…
6 tasks done
1
@bittersweet1999
feat: upgrade MiniMax default model to M3
#2418 opened Mar 20, 2026 by octo-patch Loading…
3 tasks done
@tonysy
[Fix] CEval ModelScope load and HF generate for causal LMs
#2416 opened Mar 19, 2026 by DeliWang Loading…
6 tasks
@acylam
1
Add support for Azure OpenAI models and managed identity auth
#2415 opened Mar 18, 2026 by jgbradley1 Loading…
2 of 6 tasks
[Fix] Fix eval stage is extremely slow
#2409 opened Mar 5, 2026 by xming521 Loading…
6 tasks
@acylam
3
fix: correct typo 'seperated' to 'separated'
#2397 opened Feb 9, 2026 by thecaptain789 Loading…
@bittersweet1999
Update README.md for mmlu
#2374 opened Dec 29, 2025 by freemedom Loading…
@bittersweet1999
[Dataset] Add dataset arena-hard-v2
#2362 opened Dec 16, 2025 by Myhs-phz Collaborator Loading…
@liushz
ProTip! Exclude everything labeled bug with -label:bug.