All issues

Search results

Bug: unpair IterableDatasetDict preference datasets

Status: Open.

#6877 In huggingface/trl;

· YZJF opened on Aug 23, 2026

Bug: normalize --accelerate_config=<name> CLI syntax

Status: Open.

#6874 In huggingface/trl;

· YZJF opened on Aug 23, 2026

Tiny test models are incompatible with Flash Attention (head_size=2)

Status: Open.

#6857 In huggingface/trl;

· albertvillanova opened on Aug 21, 2026

CI fails for slow tests on multiple GPUs: Fatal Python error: Segmentation fault

Status: Open.

#6836 In huggingface/trl;

· albertvillanova opened on Aug 20, 2026

RFC: Add single-image vision-language model support to A2POTrainer

Status: Open.

#6833 In huggingface/trl;

· DimensionSTP opened on Aug 20, 2026

RFC: Add end-to-end vision-language model support to SDPOTrainer

Status: Open.

#6832 In huggingface/trl;

· DimensionSTP opened on Aug 20, 2026

RFC: Support A2PO with DeepSpeed ZeRO-3 via an explicit reference model

Status: Open.

#6831 In huggingface/trl;

· DimensionSTP opened on Aug 20, 2026

SDPO PEFT EMA initialization reads partitioned state under ZeRO-3

Status: Open.

#6828 In huggingface/trl;

· DimensionSTP opened on Aug 20, 2026

Metrics-only inaccuracies in RL trainers: unmasked stats (OnlineDPO, PPO), wrong XPO logps metric, GRPO policy_loss only logged with entropy bonus

Status: Open.

#6809 In huggingface/trl;

· mmjerge opened on Aug 19, 2026

GMPO: use_liger_kernel=True silently bypasses the GMPO loss; MoE aux loss and entropy bonus dropped (gaps not covered by #6095)

Status: Open.

#6808 In huggingface/trl;

· mmjerge opened on Aug 19, 2026

gspo_token: _compute_loss is a stale copy of GRPO's — use_bias_correction_kl, OPSM, entropy bonus, and MoE aux loss silently ignored

Status: Open.

#6807 In huggingface/trl;

· mmjerge opened on Aug 19, 2026

OnlineDPO/XPO/Nash-MD: list-valued beta/alpha/mixture_coef epoch schedules crash (list indexed with float state.epoch)

Status: Open.

#6806 In huggingface/trl;

· mmjerge opened on Aug 19, 2026