LLM Name | Mixtral 4x7b Slerp |
Repository ๐ค | https://huggingface.co/monology/mixtral-4x7b_slerp |
Model Size | 24.2b |
Required VRAM | 96.8 GB |
Updated | 2024-10-18 |
Maintainer | monology |
Model Type | mixtral |
Model Files | |
Model Architecture | MixtralForCausalLM |
License | mit |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.40.0.dev0 |
Tokenizer Class | LlamaTokenizer |
Vocabulary Size | 32000 |
Torch Data Type | float32 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Dzakwan MoE 4x7b Beta | 32K / 48.4 GB | 3909 | 0 |
Beyonder 4x7B V3 | 32K / 48.3 GB | 3935 | 58 |
Mera Mix 4x7B | 32K / 48.3 GB | 4463 | 18 |
Calme 4x7B MoE V0.2 | 32K / 48.3 GB | 4556 | 2 |
Calme 4x7B MoE V0.1 | 32K / 48.3 GB | 4062 | 2 |
MixtureofMerges MoE 4x7b V5 | 32K / 48.3 GB | 4058 | 1 |
CognitiveFusion2 4x7B BF16 | 32K / 48.3 GB | 4548 | 3 |
MixtureofMerges MoE 4x7b V4 | 32K / 48.3 GB | 4092 | 4 |
NeuralStar FusionWriter 4x7b | 32K / 48.3 GB | 42 | 5 |
LCARS AI 1x4 003 SuperAI | 32K / 48.5 GB | 46 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐