LLM Name | Sakura SOLAR Instruct |
Repository ๐ค | https://huggingface.co/kyujinpy/Sakura-SOLAR-Instruct |
Model Size | 10.7b |
Required VRAM | 21.4 GB |
Updated | 2025-01-29 |
Maintainer | kyujinpy |
Model Type | llama |
Instruction-Based | Yes |
Model Files | |
Supported Languages | en |
Model Architecture | LlamaForCausalLM |
License | cc-by-nc-sa-4.0 |
Context Length | 4096 |
Model Max Length | 4096 |
Transformers Version | 4.34.0 |
Tokenizer Class | LlamaTokenizer |
Padding Token | </s> |
Vocabulary Size | 32000 |
Torch Data Type | float16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
Sakura SOLAR Instruct GGUF | 5 | 104 | 4 GB |
Sakura SOLAR Instruct GPTQ | 3 | 14 | 6 GB |
Sakura SOLAR Instruct AWQ | 1 | 6 | 6 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
SOLAR 10.7B Instruct V1.0 128K | 128K / 21.4 GB | 216 | 4 |
SOLAR 10.7B V1.0 Instruct 16K | 16K / 21.4 GB | 63 | 2 |
SauerkrautLM SOLAR Instruct | 8K / 21.4 GB | 1002 | 46 |
MetaModelv2 | 8K / 21.4 GB | 1026 | 0 |
Kazemi 1.2 Solar | 8K / 21.4 GB | 0 | 0 |
SOLAR 10.7B Instruct V1.0 | 4K / 21.4 GB | 61326 | 619 |
Somer2 | 4K / 21.4 GB | 38 | 0 |
Solarmer3 | 4K / 21.4 GB | 14 | 0 |
Somer | 4K / 21.4 GB | 11 | 0 |
ConfigurableSOLAR 10.7B | 4K / 21.4 GB | 5370 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐