๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐
Best Alternatives |
HF Rank |
Context/RAM |
Downloads |
Likes |
---|---|---|---|---|
Smaug Mixtral V0.1 | 75.49 | 32K / 187.7 GB | 3213 | 12 |
BagelMIsteryTour V2 8x7B | 74.95 | 32K / 93.5 GB | 1350 | 16 |
BagelMIsteryTour 8x7B | 74.66 | 32K / 93.5 GB | 1350 | 4 |
Prokaryote 8x7B Bf16 | 74.53 | 32K / 93.5 GB | 2008 | 2 |
Mhm 8x7B FrankenMoE V1.0 | 74.01 | 32K / 93.5 GB | 1972 | 2 |
Typhon Mixtral V1 | 73.81 | 32K / 93.4 GB | 530 | 7 |
UNAversal 8x7B V1beta | 73.78 | 32K / 93.6 GB | 1927 | 8 |
Open Gpt4 8x7B V0.2 | 73.59 | 32K / 93.5 GB | 1998 | 9 |
Mixtral 8x7B Instruct V0.1 DPO | 73.44 | 32K / 93.6 GB | 1904 | 1 |
Eukaryote 8x7B Bf16 | 73.23 | 8K / 93.5 GB | 1939 | 1 |
LLM Name | Franziska Mixtral V1 |
Repository | Open on ๐ค |
Merged Model | Yes |
Model Size | 46.7b |
Required VRAM | 93.5 GB |
Updated | 2024-06-24 |
Maintainer | Sao10K |
Model Type | mixtral |
Model Files | |
Supported Languages | en |
Model Architecture | MixtralForCausalLM |
License | cc-by-nc-4.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.39.2 |
Tokenizer Class | LlamaTokenizer |
Vocabulary Size | 32000 |
Initializer Range | 0.02 |
Torch Data Type | bfloat16 |