LLM Name | Beyonder 4x7B V3 Random Lora |
Repository | Open on ๐ค |
Base Model(s) | |
Model Size | 24.2b |
Required VRAM | 48.5 GB |
Updated | 2024-07-26 |
Maintainer | Aratako |
Model Type | mixtral |
Model Files | |
Model Architecture | MixtralForCausalLM |
License | cc-by-nc-4.0 |
Context Length | 32768 |
Model Max Length | 32768 |
Transformers Version | 4.36.2 |
Tokenizer Class | LlamaTokenizer |
Padding Token | [PAD] |
Vocabulary Size | 32001 |
LoRA Model | Yes |
Torch Data Type | bfloat16 |
Best Alternatives |
HF Rank |
Context/RAM |
Downloads |
Likes |
---|---|---|---|---|
Beyonder 4x7B V3 | 0.3 | 32K / 48.3 GB | 3796 | 56 |
NeuralStar FusionWriter 4x7b | 0.3 | 32K / 48.3 GB | 7 | 0 |
Dzakwan MoE 4x7b Beta | 0.3 | 32K / 48.4 GB | 2035 | 0 |
Mixtral 4x7b Slerp | 0.3 | 32K / 96.8 GB | 255 | 1 |
Mera Mix 4x7B | 0.3 | 32K / 48.3 GB | 4325 | 17 |
CognitiveFusion2 4x7B BF16 | 0.3 | 32K / 48.3 GB | 4426 | 3 |
...erges MoE 4x7b V10 Mixtralv0.3 | 0.3 | 32K / 48.3 GB | 261 | 0 |
NeuralMona MoE 4x7B | 0.3 | 32K / 48.3 GB | 3867 | 0 |
Calme 4x7B MoE V0.1 | 0.3 | 32K / 48.3 GB | 3310 | 2 |
Calme 4x7B MoE V0.2 | 0.3 | 32K / 48.3 GB | 3209 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐