Issues

• Unexpected keyword argument 'beta' in DPOTrainer initialization

  RLHFlow/Online-RLHF#32 · Filter by author YijuGuo opened on Dec 19, 2024
  1

• Inquiry about the version of alignment-handbook used in the installation guide

  RLHFlow/Online-RLHF#31 · Filter by author YijuGuo opened on Dec 17, 2024
  1

• Unable to install axolotl due to missing bitsandbytes==0.45.0 dependency

  RLHFlow/Online-RLHF#30 · Filter by author YijuGuo opened on Dec 16, 2024
  2

• Questions About Data chosen Strategies

  RLHFlow/Online-RLHF#29 · Filter by author nantenT opened on Dec 9, 2024
  2

• About the results of vanilla DPO

  RLHFlow/Online-RLHF#28 · Filter by author lucasliunju opened on Nov 18, 2024
  1

• Reward-KL Comparison

  RLHFlow/Online-RLHF#27 · Filter by author vincezh2000 opened on Nov 10, 2024
  1

• SFT training objective

  RLHFlow/Online-RLHF#24 · Filter by author ljb121002 opened on Oct 18, 2024
  3

• Negative reward when serving ArmoRM-Llama3-8B-v0.1

  RLHFlow/Online-RLHF#23 · Filter by author maoliyuan opened on Aug 29, 2024
  4

• Question about CUDA/NVCC setups

  RLHFlow/Online-RLHF#22 · Filter by author rqzhangberkeley opened on Aug 16, 2024
  1

• Questions about Nectar Datasets

  RLHFlow/Online-RLHF#20 · Filter by author XinZhao0211 opened on Aug 9, 2024
  4

• Phi3 has a nearly constant DPO loss of 0.69xx

  RLHFlow/Online-RLHF#17 · Filter by author Arnav0400 opened on Jul 18, 2024
  6

• Fail to load weight from pair-preference-model-LLaMA3-8B

  RLHFlow/Online-RLHF#4 · Filter by author matouk98 opened on May 31, 2024
  2