Synthetic RLHF w up to 66% success rate

Synthetic RLHF w up to 66% success rate(twitter.com)

2 points by reality_inspctr 3 years ago | 1 comment

"We are releasing AlpacaFarm, a simulator enabling everyone to run and study the full RLHF pipeline at a fraction of the time (<24h) and cost (<$200) w/ LLM-simulated annotators. Starting w/ Alpaca, we show RLHF gives big 10+% winrate gains vs davinci003 (http://crfm.stanford.edu/2023/05/22/alpaca-farm.html)"

reality_inspctr 3 years ago |

"We are releasing AlpacaFarm, a simulator enabling everyone to run and study the full RLHF pipeline at a fraction of the time (<24h) and cost (<$200) w/ LLM-simulated annotators. Starting w/ Alpaca, we show RLHF gives big 10+% winrate gains vs davinci003 (http://crfm.stanford.edu/2023/05/22/alpaca-farm.html)"