LLM Name | Mixtral Quantized |
Repository ๐ค | https://huggingface.co/alquimista888/mixtral_quantized |
Model Size | 7.2b |
Required VRAM | 14.4 GB |
Updated | 2024-09-08 |
Maintainer | alquimista888 |
Model Type | mistral |
Model Files | |
GGUF Quantization | Yes |
Quantization Type | gguf |
Model Architecture | MistralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.36.0 |
Tokenizer Class | LlamaTokenizer |
Vocabulary Size | 32000 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
LCARS AI 001 | 32K / 14.4 GB | 86 | 4 |
Zion Alpha | 32K / 14.4 GB | 2576 | 2 |
Zsql En Postgres | 32K / 14.4 GB | 91 | 5 |
Mayonnaise 4in1 02 | 32K / 14.4 GB | 83 | 0 |
MHENNlitv3 | 32K / 28.9 GB | 11 | 0 |
MHENNlitv2 | 32K / 28.9 GB | 10 | 0 |
MHENNcodemathv2 | 32K / 28.9 GB | 8 | 0 |
MHENNcodemath | 32K / 28.9 GB | 14 | 0 |
Zephyr DPO V2 | 32K / 14.4 GB | 1216 | 1 |
AI Tutor | 32K / 14.5 GB | 6 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐