LLM Name | Beyonder 4x7B V3 |
Repository ๐ค | https://huggingface.co/mlabonne/Beyonder-4x7B-v3 |
Base Model(s) | |
Model Size | 24.2b |
Required VRAM | 48.3 GB |
Updated | 2024-10-17 |
Maintainer | mlabonne |
Model Type | mixtral |
Model Files | |
Model Architecture | MixtralForCausalLM |
License | cc-by-nc-4.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.39.0 |
Tokenizer Class | LlamaTokenizer |
Padding Token | <s> |
Vocabulary Size | 32000 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Dzakwan MoE 4x7b Beta | 32K / 48.4 GB | 3909 | 0 |
Mera Mix 4x7B | 32K / 48.3 GB | 4487 | 18 |
Calme 4x7B MoE V0.2 | 32K / 48.3 GB | 4556 | 2 |
Calme 4x7B MoE V0.1 | 32K / 48.3 GB | 4062 | 2 |
MixtureofMerges MoE 4x7b V5 | 32K / 48.3 GB | 4058 | 1 |
CognitiveFusion2 4x7B BF16 | 32K / 48.3 GB | 4548 | 3 |
MixtureofMerges MoE 4x7b V4 | 32K / 48.3 GB | 4092 | 4 |
NeuralStar FusionWriter 4x7b | 32K / 48.3 GB | 42 | 5 |
LCARS AI 1x4 003 SuperAI | 32K / 48.5 GB | 46 | 2 |
Mixtral 4x7b Slerp | 32K / 96.8 GB | 9 | 1 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐