CeptrixBeagle 12B MoE By allknowingroger: Benchmarks, Features and Detailed Analysis. Insights on CeptrixBeagle 12B MoE.

Allknowingroger/neuralceptrix-... Autotrain compatible Base model:allknowingroger/neu... Base model:merge:allknowingrog... Base model:merge:paulml/omnibe... Base model:paulml/omnibeaglesq... Endpoints compatible Frankenmoe Lazymergekit Merge Mergekit Mixtral Moe Paulml/omnibeaglesquaredmbx-v3... Region:us Safetensors Sharded Tensorflow

CeptrixBeagle 12B MoE Benchmarks

ARC: 72.78^-24.4%

HellaSwag: 89.25^-6.3%

MMLU: 64.18^-25.8%

TruthfulQA: 78.45^33%

WinoGrande: 85.08^-2.8%

GSM8K: 68.61^-25.4%

^nn.n% — How the model compares to the GPT-4.

CeptrixBeagle 12B MoE Parameters and Internals

LLM Name	CeptrixBeagle 12B MoE
Repository	Open on 🤗
Base Model(s)	NeuralCeptrix 7B Slerp OmniBeagleSquaredMBX V3 7B allknowingroger/NeuralCeptrix-7B-slerp paulml/OmniBeagleSquaredMBX-v3-7B
Model Size	7b
Required VRAM	25.8 GB
Updated	2024-07-26
Maintainer	allknowingroger
Model Type	mixtral
Model Files	1.9 GB: 1-of-13 2.0 GB: 2-of-13 2.0 GB: 3-of-13 2.0 GB: 4-of-13 2.0 GB: 5-of-13 2.0 GB: 6-of-13 2.0 GB: 7-of-13 2.0 GB: 8-of-13 2.0 GB: 9-of-13 2.0 GB: 10-of-13 2.0 GB: 11-of-13 2.0 GB: 12-of-13 1.9 GB: 13-of-13
Model Architecture	MixtralForCausalLM
License	apache-2.0
Context Length	32768
Model Max Length	32768
Transformers Version	4.39.3
Tokenizer Class	LlamaTokenizer
Padding Token	<s>
Vocabulary Size	32000
Torch Data Type	bfloat16

CeptrixBeagle 12B MoE (allknowingroger/CeptrixBeagle-12B-MoE)

Best Alternatives to CeptrixBeagle 12B MoE

Best Alternatives	HF Rank	Context/RAM	Downloads	Likes
Multimaster 7B V6	0.3	32K / 142.5 GB	2715	1
Mixtral 7B 8expert	0.3	32K / 93.6 GB	12752	260
MultiverseBuddy 15B MoE	0.3	32K / 25.8 GB	255	0
Mini Mixtral V0.2	0.2	32K / 25.8 GB	318	3
Laserxtral	0.2	32K / 48.3 GB	942	78
Lumina 2	0.2	32K / 37.1 GB	255	0
RogerWizard 12B MoE	0.2	32K / 25.8 GB	252	1
StarlingMaths 12B MoE	0.2	32K / 25.8 GB	253	0
MultiverseMath 12B MoE	0.2	32K / 25.8 GB	275	0
WestLakeLaser 12B MoE	0.2	32K / 25.8 GB	256	0

Note: green Score (e.g. "73.2") means that the model is better than allknowingroger/CeptrixBeagle-12B-MoE.

Rank the CeptrixBeagle 12B MoE Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 34446 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v2024072501

Support LLM Explorer

CeptrixBeagle 12B MoE by allknowingroger

» All LLMs » allknowingroger » CeptrixBeagle 12B MoE URL Share it on

CeptrixBeagle 12B MoE Benchmarks

CeptrixBeagle 12B MoE Parameters and Internals

Best Alternatives to CeptrixBeagle 12B MoE

Rank the CeptrixBeagle 12B MoE Capabilities

What open-source LLMs or SLMs are you in search of? 34446 in total.