LLM Name | Soro |
Repository ๐ค | https://huggingface.co/zaddyzaddy/soro |
Base Model(s) | |
Model Size | 8b |
Required VRAM | 5.8โฏGB |
Updated | 2025-02-04 |
Maintainer | zaddyzaddy |
Model Files | |
Quantization Type | 4bit |
Model Architecture | Adapter |
Model Max Length | 8192 |
Is Biased | none |
Tokenizer Class | PreTrainedTokenizerFast |
Padding Token | <|reserved_special_token_250|> |
PEFT Type | LORA |
LoRA Model | Yes |
PEFT Target Modules | down_proj|up_proj|gate_proj|k_proj|v_proj|q_proj|o_proj |
LoRA Alpha | 16 |
LoRA Dropout | 0 |
R Param | 16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Arabic DeepSeek R1 Distill 8B | 0K / 0โGB | 2135 | 4 |
Llama 3 8B Muxue 1.0 Lora | 0K / 0.2โGB | 25 | 0 |
...ma3 Instruct Chat FCAIBylaw V1 | 0K / 0.2โGB | 5 | 0 |
BlueMoon Llama3 | 0K / 0.7โGB | 10 | 0 |
Llama3 RP ORPO LoRA | 0K / 0.7โGB | 37 | 0 |
RP Format QuoteAsterisk Llama3 | 0K / 1.3โGB | 7 | 0 |
Theory Of Mind Llama3 | 0K / 1.3โGB | 7 | 0 |
Llama3 Aesir Preview LoRA 128 | 0K / 1.3โGB | 38 | 0 |
Llama3 RP ORPO LoRA | 0K / 0.7โGB | 5 | 0 |
Lora Model | 0K / 0.2โGB | 8 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐