Training Details |
|
LLM Name | Qwen2 0.5B DPO |
Repository ๐ค | https://huggingface.co/trl-lib/Qwen2-0.5B-DPO |
Model Name | dpo-qwen2 |
Base Model(s) | |
Model Size | 0.5b |
Required VRAM | 2 GB |
Updated | 2025-02-19 |
Maintainer | trl-lib |
Model Type | qwen2 |
Instruction-Based | Yes |
Model Files | |
Model Architecture | Qwen2ForCausalLM |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.45.0.dev0 |
Tokenizer Class | Qwen2Tokenizer |
Padding Token | <|endoftext|> |
Vocabulary Size | 151936 |
Torch Data Type | float32 |
Errors | replace |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Qwen2 0.5B Abyme Merge3 | 128K / 1.3 GB | 61 | 0 |
Qwen2 0.5B Abyme Merge2 | 128K / 0.3 GB | 52 | 0 |
Qwen2.5 0.5B Instruct | 32K / 1 GB | 984916 | 225 |
QwQ 0.5B Distilled SFT | 32K / 1 GB | 4661 | 22 |
Lb Reranker 0.5B V1.0 | 32K / 1 GB | 1906 | 63 |
Qwen2.5 Coder 0.5B Instruct | 32K / 1 GB | 41556 | 33 |
Qwen2 0.5B Instruct | 32K / 1 GB | 188034 | 175 |
FastThink 0.5B Tiny | 32K / 1 GB | 523 | 10 |
Feynman Grpo Exp | 32K / 1 GB | 175 | 7 |
Bellatrix Tiny 0.5B | 32K / 1 GB | 506 | 7 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐