Mistral 7B Orca DPO 2h By SC56: Benchmarks, Features and Detailed Analysis. Insights on Mistral 7B Orca DPO 2h.

Arxiv:1910.09700 Adapter Finetuned Lora Region:us Safetensors

Mistral 7B Orca DPO 2h Benchmarks

ARC: 73.12^-24.1%

HellaSwag: 88.65^-7%

MMLU: 64.99^-24.9%

TruthfulQA: 71.31^20.9%

WinoGrande: 84.21^-3.8%

GSM8K: 70.58^-23.3%

^nn.n% — How the model compares to the GPT-4.

Mistral 7B Orca DPO 2h Parameters and Internals

LLM Name	Mistral 7B Orca DPO 2h
Repository	Open on 🤗
Model Size	7b
Required VRAM	0.1 GB
Updated	2024-07-27
Maintainer	SC56
Model Files	0.1 GB
Model Architecture	Adapter
License	cc-by-4.0
Is Biased	none
PEFT Type	LORA
LoRA Model	Yes
PEFT Target Modules	up_proj\|o_proj\|down_proj\|v_proj\|k_proj\|gate_proj\|q_proj
LoRA Alpha	16
LoRA Dropout	0.05
R Param	16

Mistral 7B Orca DPO 2h (SC56/Mistral-7B-orca-dpo-2h)

Quantized Models of the Mistral 7B Orca DPO 2h

Model	Likes	Downloads	VRAM
...andle Mistral 7B Instruct V0.2	0	94	14 GB

Best Alternatives to Mistral 7B Orca DPO 2h

Best Alternatives	HF Rank	Context/RAM	Downloads	Likes
CodeAstra 7B	0.3	0K / 0 GB	651	2
...Sql Flash Attention 2 Dataeval	0.3	0K / 1.9 GB	754	2
...V0.1 Llm On Ray Deepspeed Lora	0.3	0K / 0 GB	212	0
Lora Adapted Mistral 7B	0.3	0K / 0 GB	139	0
Qwen1.5 7B Chat Sa V0.1	0.3	0K / 0 GB	5	0
...al 7B Instruct V0.3 1719344430	0.3	0K / 3.5 GB	86	0
...al 7B Instruct V0.3 1719350528	0.3	0K / 0.9 GB	80	0
...al 7B Instruct V0.3 1719098465	0.3	0K / 0 GB	94	0
...al 7B Instruct V0.3 1719301256	0.3	0K / 0.9 GB	77	0
...al 7B Instruct V0.3 1719255815	0.3	0K / 0 GB	81	0

Note: green Score (e.g. "73.2") means that the model is better than SC56/Mistral-7B-orca-dpo-2h.

Rank the Mistral 7B Orca DPO 2h Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 34447 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v2024072501

Support LLM Explorer