ELYZA Japanese Llama 2 13B Fast Instruct GGUF by second-state

 ยป  All LLMs  ยป  second-state  ยป  ELYZA Japanese Llama 2 13B Fast Instruct GGUF   URL Share it on

  Autotrain compatible Base model:elyza/elyza-japanes... Base model:quantized:elyza/ely...   En   Gguf   Instruct   Ja   Llama   Q2   Quantized   Region:us

ELYZA Japanese Llama 2 13B Fast Instruct GGUF Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

ELYZA Japanese Llama 2 13B Fast Instruct GGUF Parameters and Internals

LLM NameELYZA Japanese Llama 2 13B Fast Instruct GGUF
Repository ๐Ÿค—https://huggingface.co/second-state/ELYZA-japanese-Llama-2-13b-fast-instruct-GGUF 
Model NameELYZA-japanese-Llama-2-13b-fast-instruct
Model Creatorelyza
Base Model(s)  ...nese Llama 2 13B Fast Instruct   elyza/ELYZA-japanese-Llama-2-13b-fast-instruct
Model Size13b
Required VRAM5.5 GB
Updated2024-09-19
Maintainersecond-state
Model Typellama
Instruction-BasedYes
Model Files  5.5 GB   7.0 GB   6.4 GB   5.7 GB   7.5 GB   8.0 GB   7.5 GB   9.1 GB   9.3 GB   9.1 GB   10.8 GB   14.0 GB
Supported Languagesja en
GGUF QuantizationYes
Quantization Typegguf|q2|q4_k|q5_k
Model ArchitectureLlamaForCausalLM
Licensellama2
Context Length4096
Model Max Length4096
Transformers Version4.34.1
Vocabulary Size44581
Torch Data Typebfloat16
ELYZA Japanese Llama 2 13B Fast Instruct GGUF (second-state/ELYZA-japanese-Llama-2-13b-fast-instruct-GGUF)

Best Alternatives to ELYZA Japanese Llama 2 13B Fast Instruct GGUF

Best Alternatives
Context / RAM
Downloads
Likes
CodeLlama 13B Instruct GGUF16K / 5.4 GB39912
CodeLlama 13B Instruct Fp1616K / 26 GB144429
...Llama 13B Instruct Hf 4bit MLX16K / 7.8 GB82
...13B Instruct Nf4 Fp16 Upscaled16K / 26 GB2650
... Instruct 13B Alpacamod Lora6416K / 26 GB60
... Codellama Instruct 13B Lora6416K / 26 GB60
...ama Instruct 13B Alpaca Lora6416K / 26 GB60
...B Fast Instruct 4bit Quantized4K / 7.8 GB50
Model 007 13b V24K / 26 GB174
...igogne2 Enno 13B Sft Lora 4bit4K / 26 GB7170

Rank the ELYZA Japanese Llama 2 13B Fast Instruct GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 36026 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072803