Issues

• EXAMPLE_COUNTS transposition in eval_reward_bench_bt.py silently distorts the reported Safety score

  RLHFlow/RLHF-Reward-Modeling#63 · Filter by author shaurya416 opened on Sep 24, 2026

• [BOUNTY CLAIM] Training guide #61

  RLHFlow/RLHF-Reward-Modeling#62 · Filter by author nikos1005 opened on Jun 7, 2026

• About how to train reward model

  RLHFlow/RLHF-Reward-Modeling#61 · Filter by author weiminw opened on Jun 13, 2025
  1

• 关于训练超参

  RLHFlow/RLHF-Reward-Modeling#60 · Filter by author weiminw opened on Jun 12, 2025

• When do you plan to open-source the full code of the [decision_tree]?

  RLHFlow/RLHF-Reward-Modeling#59 · Filter by author Neroxsh opened on Jun 8, 2025

• Scores not bounded to 0 and 1

  RLHFlow/RLHF-Reward-Modeling#58 · Filter by author mgutierrezc opened on Apr 26, 2025
  2

• How to avoid gates overly relying on one head

  RLHFlow/RLHF-Reward-Modeling#55 · Filter by author zhaoxy92 opened on Feb 11, 2025

• Potential Gating Network Coding Error (on softmax) in armo-rm Stage 2

  RLHFlow/RLHF-Reward-Modeling#54 · Filter by author SWY666 opened on Jan 31, 2025
  1

• PRM Data Construct

  RLHFlow/RLHF-Reward-Modeling#52 · Filter by author Aaronhuang-778 opened on Jan 16, 2025
  3

• have trobule reproducing LLaMA-3-8B-it BT

  RLHFlow/RLHF-Reward-Modeling#49 · Filter by author jijivski opened on Jan 11, 2025
  4

• Missing code for ODIN

  RLHFlow/RLHF-Reward-Modeling#46 · Filter by author maoliyuan opened on Dec 1, 2024
  1

• Question regarding ARMO stage2-train code

  RLHFlow/RLHF-Reward-Modeling#37 · Filter by author RayWang-iat opened on Oct 15, 2024

• Armo-rm env set-up and data processing

  RLHFlow/RLHF-Reward-Modeling#35 · Filter by author MaxwellJryao opened on Sep 21, 2024
  1

• Clarification on Reward Usage in DPO Training

  RLHFlow/RLHF-Reward-Modeling#33 · Filter by author vincezh2000 opened on Sep 16, 2024
  1

• Regarding the Gemma2 Reward Model Structure

  RLHFlow/RLHF-Reward-Modeling#26 · Filter by author Loong435 opened on Aug 5, 2024
  2

• "Token pattern not found in the list" error

  RLHFlow/RLHF-Reward-Modeling#24 · Filter by author nshen7 opened on Jul 21, 2024
  6

• Bradley-Terry model removes lm head while saving

  RLHFlow/RLHF-Reward-Modeling#22 · Filter by author Arnav0400 opened on Jul 11, 2024
  1

• Training and evaluating for pair_pm model.

  RLHFlow/RLHF-Reward-Modeling#21 · Filter by author t-sifanwu opened on Jul 9, 2024
  5

• How do you implement SLic on pair_pm model?

  RLHFlow/RLHF-Reward-Modeling#20 · Filter by author t-sifanwu opened on Jun 27, 2024
  1

• environment set up issue

  RLHFlow/RLHF-Reward-Modeling#18 · Filter by author WayXG opened on Jun 21, 2024
  1

• question of chat templates

  RLHFlow/RLHF-Reward-Modeling#16 · Filter by author trueRosun opened on Jun 13, 2024
  6