Gemma 2 9B Bnb 4bit by unsloth

 ยป  All LLMs  ยป  unsloth  ยป  Gemma 2 9B Bnb 4bit   URL Share it on

  4-bit   4bit   Autotrain compatible   Bitsandbytes   En   Endpoints compatible   Gemma   Gemma2   License:gemma   Quantized   Region:us   Safetensors   Unsloth

Rank the Gemma 2 9B Bnb 4bit Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Gemma 2 9B Bnb 4bit (unsloth/gemma-2-9b-bnb-4bit)

Best Alternatives to Gemma 2 9B Bnb 4bit

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
Gemma 2 9B 4bit8K / 5.2 GB831
...ma 2 9B It SPPO Iter3 4bit Mlx8K / 5.2 GB31
Gemma 2 9B It 4bit8K / 5.2 GB2570
Gemma 2 9B It Bnb 4bit8K / 6.1 GB72898
Gemma2 9b It C Epoch3 4bit8K / 6.1 GB1150
Gemma 2 9B It 4bit8K / 6.1 GB580
Gemma2 9b It C Epoch2 4bit8K / 6.1 GB510
Gemma 2 9B It Bnb 4bit8K / 6.1 GB100
...ma 2 9B It SPPO Iter3 4bit Bnb8K / 6.5 GB171
Gemma 2 9B It 4bit8K / 6.5 GB150

Gemma 2 9B Bnb 4bit Parameters and Internals

LLM NameGemma 2 9B Bnb 4bit
RepositoryOpen on ๐Ÿค— 
Model Size9b
Required VRAM6.1 GB
Updated2024-07-13
Maintainerunsloth
Model Typegemma2
Model Files  6.1 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureGemma2ForCausalLM
Licensegemma
Context Length8192
Model Max Length8192
Transformers Version4.43.0.dev0
Tokenizer ClassGemmaTokenizer
Padding Token<pad>
Vocabulary Size256000
Initializer Range0.02
Torch Data Typebfloat16

What open-source LLMs or SLMs are you in search of? 36243 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801