LLM Name | Sakura SOLAR Instruct |
Repository ๐ค | https://huggingface.co/kyujinpy/Sakura-SOLAR-Instruct |
Model Size | 10.7b |
Required VRAM | 21.4 GB |
Updated | 2024-11-07 |
Maintainer | kyujinpy |
Model Type | llama |
Instruction-Based | Yes |
Model Files | |
Supported Languages | en |
Model Architecture | LlamaForCausalLM |
License | cc-by-nc-sa-4.0 |
Context Length | 4096 |
Model Max Length | 4096 |
Transformers Version | 4.34.0 |
Tokenizer Class | LlamaTokenizer |
Padding Token | </s> |
Vocabulary Size | 32000 |
Torch Data Type | float16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
Sakura SOLAR Instruct GGUF | 5 | 509 | 4 GB |
Sakura SOLAR Instruct GPTQ | 3 | 7 | 6 GB |
Sakura SOLAR Instruct AWQ | 1 | 9 | 6 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
SOLAR 10.7B Instruct V1.0 128K | 128K / 21.4 GB | 80 | 4 |
SOLAR 10.7B V1.0 Instruct 16K | 16K / 21.4 GB | 63 | 2 |
SauerkrautLM SOLAR Instruct | 8K / 21.4 GB | 755 | 47 |
MetaModelv2 | 8K / 21.4 GB | 1187 | 0 |
Kazemi 1.2 Solar | 8K / 21.4 GB | 0 | 0 |
SOLAR 10.7B Instruct V1.0 | 4K / 21.4 GB | 111455 | 612 |
ConfigurableSOLAR 10.7B | 4K / 21.4 GB | 3748 | 2 |
...arbonVillain En 10.7B V2 Slerp | 4K / 21.4 GB | 11378 | 0 |
...auerkrautLM UNA SOLAR Instruct | 4K / 21.4 GB | 1196 | 26 |
KULLM3 | 4K / 21.4 GB | 10726 | 42 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐