Noromaid V0.4 Mixtral Instruct 8x7b Zloss By NeverSleep: Benchmarks, Features and Detailed Analysis. Insights on Noromaid V0.4 Mixtral Instruct 8x7b Zloss.

Merged Model Autotrain compatible Conversational Endpoints compatible Instruct License:cc-by-nc-4.0 Mixtral Moe Region:us Safetensors Sharded Tensorflow

Noromaid V0.4 Mixtral Instruct 8x7b Zloss Benchmarks

HF Avg Score: 73.22 vs 86.1 (GPT-4) ^-15%

ARC: 70.48^-26.8%

HellaSwag: 87.94^-7.7%

MMLU: 71.27^-17.6%

TruthfulQA: 66.45^12.6%

WinoGrande: 81.69^-6.6%

GSM8K: 61.49^-33.2%

^nn.n% — How the model compares to the GPT-4.

Rank the Noromaid V0.4 Mixtral Instruct 8x7b Zloss Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Noromaid V0.4 Mixtral Instruct 8x7b Zloss (NeverSleep/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss)

Quantized Models of the Noromaid V0.4 Mixtral Instruct 8x7b Zloss

Model	Likes	Downloads	VRAM
...xtral Instruct 8x7b Zloss GGUF	18	1008	17 GB
...xtral Instruct 8x7b Zloss GPTQ	2	26	23 GB
...ixtral Instruct 8x7b Zloss AWQ	1	6	24 GB

Best Alternatives to Noromaid V0.4 Mixtral Instruct 8x7b Zloss

Best Alternatives	HF Rank	Context/RAM	Downloads	Likes
BagelMIsteryTour V2 8x7B	74.95	32K / 93.5 GB	1350	16
BagelMIsteryTour 8x7B	74.66	32K / 93.5 GB	1350	4
UNAversal 8x7B V1beta	73.78	32K / 93.6 GB	1927	8
Mixtral 8x7B Instruct V0.1 DPO	73.44	32K / 93.6 GB	1904	1
Notux 8x7b V1	72.97	32K / 93.6 GB	894	163
Merge Mixtral Prometheus 8x7B	72.81	32K / 91.9 GB	887	1
MPOMixtral 8x7B Instruct V0.1	72.8	32K / 93.6 GB	2010	0
...rkrautLM Mixtral 8x7B Instruct	72.73	32K / 93.6 GB	162818	21
TenyxChat 8x7B V1	72.72	32K / 93.6 GB	1899	12
Mixtral 8x7B Instruct V0.1	72.62	32K / 93.6 GB	386977	3918

Note: green Score (e.g. "73.2") means that the model is better than NeverSleep/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss.

Noromaid V0.4 Mixtral Instruct 8x7b Zloss Parameters and Internals

LLM Name	Noromaid V0.4 Mixtral Instruct 8x7b Zloss
Repository	Open on 🤗
Merged Model	Yes
Model Size	46.7b
Required VRAM	93.6 GB
Updated	2024-06-24
Maintainer	NeverSleep
Model Type	mixtral
Instruction-Based	Yes
Model Files	4.9 GB: 1-of-19 5.0 GB: 2-of-19 5.0 GB: 3-of-19 4.9 GB: 4-of-19 5.0 GB: 5-of-19 5.0 GB: 6-of-19 4.9 GB: 7-of-19 5.0 GB: 8-of-19 5.0 GB: 9-of-19 4.9 GB: 10-of-19 5.0 GB: 11-of-19 5.0 GB: 12-of-19 5.0 GB: 13-of-19 4.9 GB: 14-of-19 5.0 GB: 15-of-19 5.0 GB: 16-of-19 4.9 GB: 17-of-19 5.0 GB: 18-of-19 4.2 GB: 19-of-19
Model Architecture	MixtralForCausalLM
License	cc-by-nc-4.0
Context Length	32768
Model Max Length	32768
Transformers Version	4.37.0.dev0
Tokenizer Class	LlamaTokenizer
Vocabulary Size	32000
Initializer Range	0.02
Torch Data Type	bfloat16

What open-source LLMs or SLMs are you in search of? 34902 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v2024042801

Support LLM Explorer