Gemma 1.1 7B It 4bit by mlx-community

 ยป  All LLMs  ยป  mlx-community  ยป  Gemma 1.1 7B It 4bit   URL Share it on

  4bit   Autotrain compatible   Conversational   Endpoints compatible   Gemma   Mlx   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Gemma 1.1 7B It 4bit Benchmarks

Sponsored by Nebius

Gemma 1.1 7B It 4bit Parameters and Internals

Model Type 
text generation
Additional Notes 
Converted to MLX format using mlx-lm version 0.7.0
LLM NameGemma 1.1 7B It 4bit
Repository ๐Ÿค—https://huggingface.co/mlx-community/gemma-1.1-7b-it-4bit 
Base Model(s)  unsloth/gemma-1.1-7b-it   unsloth/gemma-1.1-7b-it
Model Size7b
Required VRAM5.9โ€ฏGB
Updated2024-12-29
Maintainermlx-community
Model Typegemma
Model Files  5.3 GB: 1-of-2   0.6 GB: 2-of-2
Quantization Type4bit
Model ArchitectureGemmaForCausalLM
Licensegemma
Context Length8192
Model Max Length8192
Transformers Version4.39.3
Padding Token<pad>
Vocabulary Size256000
Torch Data Typebfloat16

Best Alternatives to Gemma 1.1 7B It 4bit

Best Alternatives
Context / RAM
Downloads
Likes
...t Cleaner Gemma 32k Merged 16b31K / 17.1โ€‰GB210
...ruct Malayalam Model Vllm 4bit16K / 5.6โ€‰GB180
... Codegemma 2 7B It Alpaca V1.28K / 17.1โ€‰GB180
Codegemma 7B It 8bit8K / 9.5โ€‰GB3234
Gemma 7B Bnb 4bit8K / 5.6โ€‰GB337817
Fbt Gemma 7B8K / 17.1โ€‰GB160
Codegemma 7B It 4bit8K / 5.9โ€‰GB411
Codegemma 7B 4bit8K / 5.9โ€‰GB200
Swahili Gemma8K / 17.1โ€‰GB431
Gemma 1.1 7B It 4bit8K / 5.9โ€‰GB161
Note: green Score (e.g. "73.2") means that the model is better than mlx-community/gemma-1.1-7b-it-4bit.

Rank the Gemma 1.1 7B It 4bit Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
โ—โ—โ—โ—
Factuality and Completeness of Knowledge  
โ—โ—โ—โ—
Censorship and Alignment  
โ—โ—โ—โ—
Data Analysis and Insight Generation  
โ—โ—โ—โ—
Text Generation  
โ—โ—โ—โ—
Text Summarization and Feature Extraction  
โ—โ—โ—โ—
Code Generation  
โ—โ—โ—โ—
Multi-Language Support and Translation  
โ—โ—โ—โ—

What open-source LLMs or SLMs are you in search of? 40410 in total.

Our Social Media โ†’  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227