๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐
Best Alternatives |
HF Rank |
Context/RAM |
Downloads |
Likes |
---|---|---|---|---|
Mistral 7B Instruct V0.1 GPTQ | — | 32K / 4.2 GB | 340779 | 73 |
Mistral 7B Instruct V0.2 GPTQ | — | 32K / 4.2 GB | 19606 | 41 |
...ral 7B Instruct V0.3 GPTQ 4bit | — | 32K / 4.2 GB | 2782 | 9 |
Dolphin 2.6 Mistral 7B GPTQ | — | 32K / 4.2 GB | 90 | 9 |
...olphin 2.6 Mistral 7B DPO GPTQ | — | 32K / 4.2 GB | 24 | 9 |
...tablelm Instruct Gamma 7B GPTQ | — | 32K / 4.2 GB | 6 | 6 |
...antha Mistral Instruct 7B GPTQ | — | 32K / 4.2 GB | 127 | 5 |
... 7B Instruct V0.2 Code Ft GPTQ | — | 32K / 4.2 GB | 21 | 5 |
... 2.6 Mistral 7B DPO Laser GPTQ | — | 32K / 4.2 GB | 80 | 3 |
KAI 7B Instruct GPTQ | — | 32K / 4.2 GB | 6 | 3 |
LLM Name | Bielik 7B Instruct V0.1 GPTQ |
Repository | Open on ๐ค |
Base Model(s) | |
Model Size | 7b |
Required VRAM | 4.2 GB |
Updated | 2024-07-01 |
Maintainer | speakleash |
Model Type | mistral |
Instruction-Based | Yes |
Model Files | |
Supported Languages | pl |
GPTQ Quantization | Yes |
Quantization Type | gptq |
Model Architecture | MistralForCausalLM |
License | cc-by-nc-4.0 |
Context Length | 4096 |
Model Max Length | 4096 |
Transformers Version | 4.39.3 |
Tokenizer Class | LlamaTokenizer |
Vocabulary Size | 32000 |
Initializer Range | 0.02 |
Torch Data Type | float16 |