LLM Name | NeuralMona MoE 4x7B |
Repository ๐ค | https://huggingface.co/CultriX/NeuralMona_MoE-4x7B |
Base Model(s) | |
Model Size | 24.2b |
Required VRAM | 48.3 GB |
Updated | 2024-10-18 |
Maintainer | CultriX |
Model Type | mixtral |
Model Files | |
Model Architecture | MixtralForCausalLM |
License | apache-2.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.39.1 |
Tokenizer Class | LlamaTokenizer |
Padding Token | <s> |
Vocabulary Size | 32000 |
Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Dzakwan MoE 4x7b Beta | 32K / 48.4 GB | 3888 | 0 |
Beyonder 4x7B V3 | 32K / 48.3 GB | 3935 | 58 |
Mera Mix 4x7B | 32K / 48.3 GB | 4463 | 18 |
Calme 4x7B MoE V0.2 | 32K / 48.3 GB | 4527 | 2 |
Calme 4x7B MoE V0.1 | 32K / 48.3 GB | 4062 | 2 |
MixtureofMerges MoE 4x7b V5 | 32K / 48.3 GB | 4058 | 1 |
CognitiveFusion2 4x7B BF16 | 32K / 48.3 GB | 4548 | 3 |
MixtureofMerges MoE 4x7b V4 | 32K / 48.3 GB | 4092 | 4 |
NeuralStar FusionWriter 4x7b | 32K / 48.3 GB | 44 | 5 |
LCARS AI 1x4 003 SuperAI | 32K / 48.5 GB | 46 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐