LLM Name | SauerkrautLM Mixtral 8x7B Instruct |
Repository | Open on ๐ค |
Model Size | 46.7b |
Required VRAM | 93.6 GB |
Updated | 2024-07-27 |
Maintainer | VAGOsolutions |
Model Type | mixtral |
Instruction-Based | Yes |
Model Files | |
Supported Languages | en de fr it es |
Model Architecture | MixtralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.36.0.dev0 |
Tokenizer Class | LlamaTokenizer |
Padding Token | </s> |
Vocabulary Size | 32000 |
Torch Data Type | bfloat16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
...utLM Mixtral 8x7B Instruct AWQ | 2 | 1565 | 24 GB |
...tLM Mixtral 8x7B Instruct GPTQ | 3 | 490 | 23 GB |
...tLM Mixtral 8x7B Instruct GGUF | 9 | 344 | 15 GB |
Best Alternatives |
HF Rank |
Context/RAM |
Downloads |
Likes |
---|---|---|---|---|
Mixtral 8x7B Instruct V0.1 | 0.6 | 32K / 93.6 GB | 651236 | 3978 |
Dolphin 2.5 Mixtral 8x7b | 0.4 | 32K / 93.6 GB | 56312 | 1182 |
Notux 8x7b V1 | 0.3 | 32K / 93.6 GB | 21 | 164 |
Karakuri Lm 8x7b Instruct V0.1 | 0.3 | 32K / 93.6 GB | 1114 | 16 |
XLAM V0.1 R | 0.3 | 32K / 93.6 GB | 586 | 41 |
Firefunction V1 | 0.3 | 32K / 93.6 GB | 806 | 121 |
Autotrain Xva0j Mixtral8x7b | 0.3 | 32K / 93.6 GB | 305 | 0 |
Mixtral 8x7B Instruct V0.1 FP8 | 0.3 | 32K / 47.1 GB | 698 | 2 |
Autotrain Mixtral 8x7b Orpo V2 | 0.3 | 32K / 93.6 GB | 242 | 0 |
Autotrain Mixtral 8x7b Orpo V1 | 0.3 | 32K / 93.6 GB | 250 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐