Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
SoraWatermarkRemover
Log In
Sign Up
trl-lib
/
Qwen2-0.5B-ORPO
like
2
Follow
TRL
165
Text Generation
Transformers
Safetensors
trl-lib/ultrafeedback_binarized
qwen2
Generated from Trainer
trl
orpo
conversational
text-generation-inference
arxiv:
2403.07691
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
e52e612
Qwen2-0.5B-ORPO
1.52 kB
1 contributor
History:
1 commit
qgallouedec
HF Staff
initial commit
e52e612
verified
about 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
about 1 year ago