LLM Name | MistralBase 4x7B MoE ECE PRYMMAL Martial |
Repository ๐ค | https://huggingface.co/Marsouuu/MistralBase-4x7B-MoE-ECE-PRYMMAL-Martial |
Base Model(s) | |
Model Size | 24.2b |
Required VRAM | 48.6 GB |
Updated | 2025-02-05 |
Maintainer | Marsouuu |
Model Type | mixtral |
Model Files | |
Supported Languages | en |
Model Architecture | MixtralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.45.1 |
Tokenizer Class | LlamaTokenizer |
Padding Token | <s> |
Vocabulary Size | 32768 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Dzakwan MoE 4x7b Beta | 32K / 48.4 GB | 5022 | 0 |
Beyonder 4x7B V3 | 32K / 48.3 GB | 5310 | 58 |
Calme 4x7B MoE V0.2 | 32K / 48.3 GB | 6510 | 2 |
Calme 4x7B MoE V0.1 | 32K / 48.3 GB | 5164 | 2 |
Mera Mix 4x7B | 32K / 48.3 GB | 3897 | 18 |
Proto Athena 4x7B | 32K / 48.4 GB | 8 | 0 |
Proto Athena V0.2 4x7B | 32K / 48.4 GB | 5 | 0 |
CognitiveFusion2 4x7B BF16 | 32K / 48.3 GB | 4275 | 3 |
MixtureofMerges MoE 4x7b V5 | 32K / 48.3 GB | 3090 | 1 |
MixtureofMerges MoE 4x7b V4 | 32K / 48.3 GB | 3100 | 4 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐