LLM Name | Eclipse Mistral 4x7b |
Repository ๐ค | https://huggingface.co/NotAiLOL/Eclipse-mistral-4x7b |
Base Model(s) | |
Model Size | 24.2b |
Required VRAM | 48.5 GB |
Updated | 2024-08-10 |
Maintainer | NotAiLOL |
Model Type | mixtral |
Instruction-Based | Yes |
Model Files | |
Model Architecture | MixtralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.40.2 |
Tokenizer Class | LlamaTokenizer |
Padding Token | <s> |
Vocabulary Size | 32000 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Proto Athena 4x7B | 32K / 48.4 GB | 8 | 0 |
Proto Athena V0.2 4x7B | 32K / 48.4 GB | 5 | 0 |
...erges MoE 4x7b V10 Mixtralv0.3 | 32K / 48.3 GB | 8 | 0 |
MoE Merging | 32K / 48.3 GB | 1214 | 0 |
Sixtyoneeighty 4x7B V1 | 32K / 48.3 GB | 52 | 0 |
MixtureofMerges MoE 4x7bRP V11 | 32K / 48.3 GB | 8 | 1 |
...icon Mixtral87 Merged Torch212 | 32K / 26.7 GB | 5 | 0 |
Kicon Mixtral87 Merged 41766 | 32K / 26.7 GB | 5 | 0 |
Boundary Mistral 4x7b MoE | 32K / 48.7 GB | 117 | 1 |
...x7b Quantized Portuguese Luana | 32K / 26.7 GB | 50 | 1 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐