Arxiv:1705.03551 Arxiv:1810.12440 Arxiv:1903.00161 Arxiv:1904.09728 Arxiv:1905.07830 Arxiv:1905.10044 Arxiv:1907.10641 Arxiv:1908.02660 Arxiv:1910.11856 Arxiv:1911.01547 Arxiv:1911.11641 Arxiv:2009.03300 Arxiv:2103.03874 Arxiv:2104.12756 Arxiv:2106.03193 Arxiv:2107.03374 Arxiv:2108.07732 Arxiv:2110.14168 Arxiv:2203.10244 Arxiv:2210.03057 Arxiv:2304.06364 Arxiv:2311.12022 Arxiv:2311.16502 Arxiv:2312.11805 Arxiv:2404.12390 Arxiv:2404.16816 Arxiv:2502.12404 Arxiv:2502.21228 Autotrain compatible Base model:google/gemma-3-1b-i... Base model:quantized:google/ge... Conversational En Endpoints compatible Gemma Gemma3 Gemma3 text Gguf Google Q2 Quantized Region:us Unsloth
Model Card on HF 🤗: https://huggingface.co/unsloth/gemma-3-1b-it-GGUF
Gemma 3 1B It GGUF Benchmarks
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
What is the LLM Explorer Rank (Score)
Gemma 3 1B It GGUF Parameters and Internals
| LLM Name | Gemma 3 1B It GGUF |
| Repository 🤗 | https://huggingface.co/unsloth/gemma-3-1b-it-GGUF |
| Base Model(s) | |
| Model Size | 1b |
| Required VRAM | 0.7 GB |
| Updated | 2025-04-28 |
| Maintainer | unsloth |
| Model Type | gemma3_text |
| Model Files | |
| Supported Languages | en |
| GGUF Quantization | Yes |
| Quantization Type | gguf|q2|q4_k|q5_k |
| Model Architecture | Gemma3ForCausalLM |
| License | gemma |
| Context Length | 32768 |
| Model Max Length | 32768 |
| Transformers Version | 4.50.0.dev0 |
| Vocabulary Size | 262144 |
| Torch Data Type | bfloat16 |
Best Alternatives to Gemma 3 1B It GGUF
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Gemma 3 1B It Bnb 4bit | 32K / 1 GB | 608649 | 6 |
| Gemma 3 1B It Unsloth Bnb 4bit | 32K / 1 GB | 61939 | 2 |
| Gemma 3 1B Pt Unsloth Bnb 4bit | 32K / 1 GB | 4006 | 1 |
| ...a 3 1B It Qat Q4 0 Unquantized | 32K / 2 GB | 269 | 4 |
| Gemma 3 1B Pt Bnb 4bit | 32K / 1 GB | 423 | 3 |
| Gemma 3 1B It | 32K / 2 GB | 2000503 | 345 |
| Gemma 3 1B Pt | 32K / 2 GB | 172037 | 108 |
| Gemma 3 1B It | 32K / 2 GB | 48876 | 8 |
| ...a 3 1B It Qat Int4 Unquantized | 32K / 2 GB | 555 | 3 |
| Gemma 3 1B Pt | 32K / 2 GB | 1958 | 3 |
Note: green Score (e.g. "73.2") means that the model is better than unsloth/gemma-3-1b-it-GGUF .
Rank the Gemma 3 1B It GGUF Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 46763 in total.
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227