LLM Name | Prem 1B ORPO |
Repository ๐ค | https://huggingface.co/ucalyptus/prem-1B-ORPO |
Model Size | 1b |
Required VRAM | 0.6 GB |
Updated | 2024-09-29 |
Maintainer | ucalyptus |
Model Files | |
Model Architecture | AutoModel |
License | other |
Model Max Length | 8192 |
Is Biased | none |
Tokenizer Class | LlamaTokenizer |
Padding Token | <pad> |
PEFT Type | LORA |
LoRA Model | Yes |
PEFT Target Modules | gate_proj|q_proj|o_proj|v_proj|up_proj|k_proj|down_proj |
LoRA Alpha | 32 |
LoRA Dropout | 0.05 |
R Param | 16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Prem 1B Chat ORPO | 0K / 0.3 GB | 0 | 1 |
Ct2fast Codegen2 1B | 0K / 2 GB | 0 | 1 |
Mergekit Slerp Ozbsicw GGUF | 0K / 2.5 GB | 27 | 0 |
Tinyllama 1B Alpaca Gguf | 0K / 0.7 GB | 5 | 0 |
Prem 1B Chat GGUF | 0K / 0.7 GB | 10 | 1 |
Bagel DPO 8x7b V0.2 GGUF | 0K / 17.3 GB | 67 | 6 |
Bagel 8x7b V0.2 GGUF | 0K / 15.6 GB | 103 | 8 |
...inyllama 2 1B Miniguanaco GGUF | 0K / 0.5 GB | 591 | 6 |
Pythia GGML | 0K / 0.1 GB | 21 | 5 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐