Arxiv:2210.17323 4-bit 4bit Ak Ar As Autotrain compatible Base model:bigscience/bloom-7b... Base model:quantized:bigscienc... Bloom Bm Bn Ca Code En Es Eu Fon Fr Gptq Gu Hi Id Ig Ki Kn Lg Ln Ml Mr Ne Nso Ny Or Pa Pt Quantized Region:us Rn Rw Safetensors Sn St Sw Ta Te Tn Ts Tum Tw Ur Vi Wo Xh Yo Zh Zhs Zht Zu
Bloom 7b1 GPTQ 4bit G128 Benchmarks
ARC: 41.13 vs 96.7 (so35)-57.5%
HellaSwag: 62 vs 95.3 (gpt4)-34.9%
MMLU: 26.25 vs 88.3 (so35)-70.3%
TruthfulQA: 38.9 vs 59 (gpt4)-34.1%
WinoGrande: 65.43 vs 87.5 (gpt4)-25.2%
GSM8K: 1.36 vs 96.4 (so35)-98.6%
LLME Score: 0.21203
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
What is the LLM Explorer Rank (Score)
Bloom 7b1 GPTQ 4bit G128 Parameters and Internals
| LLM Name | Bloom 7b1 GPTQ 4bit G128 |
| Repository 🤗 | https://huggingface.co/iproskurina/bloom-7b1-GPTQ-4bit-g128 |
| Model Name | bloom-7b1 |
| Model Creator | bigscience |
| Base Model(s) | |
| Model Size | 2.9b |
| Required VRAM | 7.3 GB |
| Updated | 2024-10-04 |
| Maintainer | iproskurina |
| Model Type | bloom |
| Model Files | |
| Supported Languages | ak ar as bm bn ca code en es eu fr gu hi id ig ki kn lg ln ml mr ne ny or pa pt rn rw sn st sw ta te tn ts tw ur vi wo xh yo zh zu |
| GPTQ Quantization | Yes |
| Quantization Type | gptq|4bit |
| Model Architecture | BloomForCausalLM |
| License | bigscience-bloom-rail-1.0 |
| Transformers Version | 4.44.2 |
| Tokenizer Class | BloomTokenizer |
| Padding Token | <pad> |
| Vocabulary Size | 250880 |
| Torch Data Type | float16 |
Best Alternatives to Bloom 7b1 GPTQ 4bit G128
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Bloom 7b1 Gptq 4bit | 0K / 7.3 GB | 27 | 2 |
Rank the Bloom 7b1 GPTQ 4bit G128 Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 36542 in total.
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072803