LLM Name | ELYZA Japanese Llama 2 13B Fast Instruct GGUF |
Repository ๐ค | https://huggingface.co/second-state/ELYZA-japanese-Llama-2-13b-fast-instruct-GGUF |
Model Name | ELYZA-japanese-Llama-2-13b-fast-instruct |
Model Creator | elyza |
Base Model(s) | |
Model Size | 13b |
Required VRAM | 5.5 GB |
Updated | 2024-09-19 |
Maintainer | second-state |
Model Type | llama |
Instruction-Based | Yes |
Model Files | |
Supported Languages | ja en |
GGUF Quantization | Yes |
Quantization Type | gguf|q2|q4_k|q5_k |
Model Architecture | LlamaForCausalLM |
License | llama2 |
Context Length | 4096 |
Model Max Length | 4096 |
Transformers Version | 4.34.1 |
Vocabulary Size | 44581 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
CodeLlama 13B Instruct GGUF | 16K / 5.4 GB | 3991 | 2 |
CodeLlama 13B Instruct Fp16 | 16K / 26 GB | 1444 | 29 |
...Llama 13B Instruct Hf 4bit MLX | 16K / 7.8 GB | 8 | 2 |
...13B Instruct Nf4 Fp16 Upscaled | 16K / 26 GB | 265 | 0 |
... Instruct 13B Alpacamod Lora64 | 16K / 26 GB | 6 | 0 |
... Codellama Instruct 13B Lora64 | 16K / 26 GB | 6 | 0 |
...ama Instruct 13B Alpaca Lora64 | 16K / 26 GB | 6 | 0 |
...B Fast Instruct 4bit Quantized | 4K / 7.8 GB | 5 | 0 |
Model 007 13b V2 | 4K / 26 GB | 17 | 4 |
...igogne2 Enno 13B Sft Lora 4bit | 4K / 26 GB | 717 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐