Beyonder 4x7B V3 Random Lora by Aratako

 ยป  All LLMs  ยป  Aratako  ยป  Beyonder 4x7B V3 Random Lora   URL Share it on

  Autotrain compatible Base model:beowolx/codeninja-1... Base model:merge:beowolx/coden... Base model:merge:mlabonne/alph... Base model:merge:mlabonne/neur... Base model:merge:sanjiwatsuki/... Base model:mlabonne/alphamonar... Base model:mlabonne/neuraldare... Base model:sanjiwatsuki/kunoic...   Conversational   Endpoints compatible   Lora   Merge   Mergekit   Mixtral   Model-index   Moe   Region:us   Safetensors   Sharded   Tensorflow

Beyonder 4x7B V3 Random Lora Parameters and Internals

LLM NameBeyonder 4x7B V3 Random Lora
RepositoryOpen on ๐Ÿค— 
Base Model(s)  AlphaMonarch 7B   beowolx/CodeNinja-1.0-OpenChat-7B   Kunoichi DPO V2 7B   NeuralDaredevil 7B   mlabonne/AlphaMonarch-7B   beowolx/CodeNinja-1.0-OpenChat-7B   SanjiWatsuki/Kunoichi-DPO-v2-7B   mlabonne/NeuralDaredevil-7B
Model Size24.2b
Required VRAM48.5 GB
Updated2024-07-26
MaintainerAratako
Model Typemixtral
Model Files  4.9 GB: 1-of-10   5.0 GB: 2-of-10   5.0 GB: 3-of-10   4.9 GB: 4-of-10   5.0 GB: 5-of-10   5.0 GB: 6-of-10   5.0 GB: 7-of-10   5.0 GB: 8-of-10   5.0 GB: 9-of-10   3.7 GB: 10-of-10
Model ArchitectureMixtralForCausalLM
Licensecc-by-nc-4.0
Context Length32768
Model Max Length32768
Transformers Version4.36.2
Tokenizer ClassLlamaTokenizer
Padding Token[PAD]
Vocabulary Size32001
LoRA ModelYes
Torch Data Typebfloat16
Beyonder 4x7B V3 Random Lora (Aratako/Beyonder-4x7B-v3-random-lora)

Best Alternatives to Beyonder 4x7B V3 Random Lora

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
Beyonder 4x7B V30.332K / 48.3 GB379656
NeuralStar FusionWriter 4x7b0.332K / 48.3 GB70
Dzakwan MoE 4x7b Beta0.332K / 48.4 GB20350
Mixtral 4x7b Slerp0.332K / 96.8 GB2551
Mera Mix 4x7B0.332K / 48.3 GB432517
CognitiveFusion2 4x7B BF160.332K / 48.3 GB44263
...erges MoE 4x7b V10 Mixtralv0.30.332K / 48.3 GB2610
NeuralMona MoE 4x7B0.332K / 48.3 GB38670
Calme 4x7B MoE V0.10.332K / 48.3 GB33102
Calme 4x7B MoE V0.20.332K / 48.3 GB32092
Note: green Score (e.g. "73.2") means that the model is better than Aratako/Beyonder-4x7B-v3-random-lora.

Rank the Beyonder 4x7B V3 Random Lora Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 34446 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072501