Skip to content

Pull requests: huggingface/trl

New pull request New
141 Open 3,032 Closed
141 Open 3,032 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Align KTO with DPO: Move completion assembly from _prepare_dataset to data collator
#5632 opened Apr 23, 2026 by albertvillanova Member Loading…
1
Align and update doc-builder commit hash in CI GitHub Actions
#5631 opened Apr 23, 2026 by albertvillanova Member Loading…
1
Add doc-builder style check to pre-commit and CI
#5630 opened Apr 23, 2026 by albertvillanova Member Loading…
1
Use PreTrainedTokenizerBase for tokenizer type hints
#5629 opened Apr 22, 2026 by qgallouedec Member Loading…
6
Add Cohere training chat template (#5471)
#5627 opened Apr 22, 2026 by dschulmeist Loading…
4 tasks done
8
Remove forward_masked_logits
#5626 opened Apr 22, 2026 by qgallouedec Member Loading…
2
feat: Add generation_kwargs support to LogCompletionsCallback and Wea…
#5625 opened Apr 22, 2026 by LhaseParth2610 Loading…
4 of 8 tasks
4
Fix entropy calculation in SFT
#5620 opened Apr 22, 2026 by qgallouedec Member Loading…
5
Renaming of internal variables: async_reward_X to async_X
#5616 opened Apr 21, 2026 by qgallouedec Member Loading…
3
Upload testing suite for DistillationTrainer
#5615 opened Apr 21, 2026 by cmpatino Collaborator Loading…
3 of 8 tasks
9
Add LoRA support for AsyncGRPO
#5610 opened Apr 21, 2026 by jonahsamost Loading…
2 of 8 tasks
5
experimental: Self-Distillation Zero
#5609 opened Apr 20, 2026 by LeonEricsson Collaborator Loading…
1 of 8 tasks
3
support prefetch/prefetch_depth for async GRPO for ~5% speedups
#5602 opened Apr 20, 2026 by winglian Contributor Loading…
1 of 8 tasks
@AmineDiro
3
fix(distillation): reverse-KL server path NaN on variable completion length
#5594 opened Apr 19, 2026 by k1064190 Loading…
3 of 8 tasks
@kashif @cmpatino
12
Fix nested vocab_size for DistillationTrainer and GOLDTrainer
#5592 opened Apr 19, 2026 by Beichen-Ma Loading…
2 of 8 tasks
1
@cmpatino
1
feat: add TargetPO trainer
#5591 opened Apr 18, 2026 by JeanKaddour • Draft
4 of 8 tasks
5
Add tiny Qwen3-4B-Instruct-2507
#5586 opened Apr 17, 2026 by qgallouedec Member Loading…
1
Chunked cross-entropy loss for SFT (up to –50% VRAM)
#5575 opened Apr 17, 2026 by qgallouedec Member Loading…
51
Add training chat template for Qwen3-2507
#5574 opened Apr 16, 2026 by SwayamInSync Contributor Loading…
5
refactor: self distillation trainers (sdpo/sdft/...)
#5573 opened Apr 16, 2026 by LeonEricsson Collaborator Loading…
2 of 8 tasks
17
Fix empty-target self-distillation loss to stay connected to model graph
#5572 opened Apr 16, 2026 by walawalagoose Loading…
3 of 8 tasks
Improve BrowserGym examples for latest OpenEnv version
#5568 opened Apr 16, 2026 by sergiopaniego Member Loading…
8 tasks
7
Set _tokenizer attribute in experimental trainers
#5566 opened Apr 16, 2026 by albertvillanova Member Loading…
4
Revert VLM support in parse_response
#5561 opened Apr 15, 2026 by qgallouedec Member • Draft
5
Accept processor in get_training_chat_template
#5560 opened Apr 15, 2026 by qgallouedec Member Loading…
7
ProTip! Follow long discussions with comments:>50.