Beyonder 4x7B V3 Random Lora by Aratako

 ยป  All LLMs  ยป  Aratako  ยป  Beyonder 4x7B V3 Random Lora   URL Share it on

  Autotrain compatible Base model:beowolx/codeninja-1... Base model:merge:beowolx/coden... Base model:merge:mlabonne/alph... Base model:merge:mlabonne/neur... Base model:merge:sanjiwatsuki/... Base model:mlabonne/alphamonar... Base model:mlabonne/neuraldare... Base model:sanjiwatsuki/kunoic...   Conversational   Endpoints compatible   Lora   Merge   Mergekit   Mixtral   Model-index   Moe   Region:us   Safetensors   Sharded   Tensorflow

Beyonder 4x7B V3 Random Lora Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Beyonder 4x7B V3 Random Lora Parameters and Internals

LLM NameBeyonder 4x7B V3 Random Lora
Repository ๐Ÿค—https://huggingface.co/Aratako/Beyonder-4x7B-v3-random-lora 
Base Model(s)  AlphaMonarch 7B   beowolx/CodeNinja-1.0-OpenChat-7B   Kunoichi DPO V2 7B   NeuralDaredevil 7B   mlabonne/AlphaMonarch-7B   beowolx/CodeNinja-1.0-OpenChat-7B   SanjiWatsuki/Kunoichi-DPO-v2-7B   mlabonne/NeuralDaredevil-7B
Model Size24.2b
Required VRAM48.5 GB
Updated2024-10-16
MaintainerAratako
Model Typemixtral
Model Files  4.9 GB: 1-of-10   5.0 GB: 2-of-10   5.0 GB: 3-of-10   4.9 GB: 4-of-10   5.0 GB: 5-of-10   5.0 GB: 6-of-10   5.0 GB: 7-of-10   5.0 GB: 8-of-10   5.0 GB: 9-of-10   3.7 GB: 10-of-10
Model ArchitectureMixtralForCausalLM
Licensecc-by-nc-4.0
Context Length32768
Model Max Length32768
Transformers Version4.36.2
Tokenizer ClassLlamaTokenizer
Padding Token[PAD]
Vocabulary Size32001
LoRA ModelYes
Torch Data Typebfloat16
Beyonder 4x7B V3 Random Lora (Aratako/Beyonder-4x7B-v3-random-lora)

Best Alternatives to Beyonder 4x7B V3 Random Lora

Best Alternatives
Context / RAM
Downloads
Likes
Dzakwan MoE 4x7b Beta32K / 48.4 GB39090
Beyonder 4x7B V332K / 48.3 GB393558
Mera Mix 4x7B32K / 48.3 GB446318
Calme 4x7B MoE V0.232K / 48.3 GB45562
Calme 4x7B MoE V0.132K / 48.3 GB40622
MixtureofMerges MoE 4x7b V532K / 48.3 GB40581
CognitiveFusion2 4x7B BF1632K / 48.3 GB45483
MixtureofMerges MoE 4x7b V432K / 48.3 GB40924
NeuralStar FusionWriter 4x7b32K / 48.3 GB425
LCARS AI 1x4 003 SuperAI32K / 48.5 GB462
Note: green Score (e.g. "73.2") means that the model is better than Aratako/Beyonder-4x7B-v3-random-lora.

Rank the Beyonder 4x7B V3 Random Lora Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 36966 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072803