LLaMA 2 Wizard 70B QLoRA By v2ray: Benchmarks, Features and Detailed Analysis. Insights on LLaMA 2 Wizard 70B QLoRA.

Adapter Conversational Dataset:wizardlm/wizardlm evol... En Finetuned Instruct Lora Region:us Safetensors

LLaMA 2 Wizard 70B QLoRA Benchmarks

ARC: 67.58 vs 96.7 (so35)^-30.1%

HellaSwag: 87.52 vs 95.3 (gpt4)^-8.2%

MMLU: 69.11 vs 88.3 (so35)^-21.7%

TruthfulQA: 61.79 vs 59 (gpt4)^4.7%

WinoGrande: 82.32 vs 87.5 (gpt4)^-5.9%

GSM8K: 30.48 vs 96.4 (so35)^-68.4%

LLME Score: 0.15336

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

LLaMA 2 Wizard 70B QLoRA Parameters and Internals

LLM Name	LLaMA 2 Wizard 70B QLoRA
Repository 🤗	https://huggingface.co/v2ray/LLaMA-2-Wizard-70B-QLoRA
Model Size	70b
Required VRAM	1.7 GB
Updated	2024-09-19
Maintainer	v2ray
Instruction-Based	Yes
Model Files	1.7 GB 1.7 GB
Supported Languages	en
Model Architecture	Adapter
License	llama2
Is Biased	none
PEFT Type	LORA
LoRA Model	Yes
PEFT Target Modules	gate_proj\|q_proj\|down_proj\|v_proj\|up_proj\|o_proj\|k_proj
LoRA Alpha	128
LoRA Dropout	0.05
R Param	64

LLaMA 2 Wizard 70B QLoRA (v2ray/LLaMA-2-Wizard-70B-QLoRA)

Quantized Models of the LLaMA 2 Wizard 70B QLoRA

Model	Likes	Downloads	VRAM
Llama 3 70B Fp16	4	1274	141 GB

Best Alternatives to LLaMA 2 Wizard 70B QLoRA

Best Alternatives	Context / RAM	Downloads	Likes
Llama 3 70B Instruct Spider	0K / 141.9 GB	6	0
Llama3v1	0K / 0.1 GB	6	0
Saiga2 70b Lora	0K / 0.3 GB	0	13
Llama 2 70B Instruct V0.1	0K / 1.1 GB	68	14

Note: green Score (e.g. "73.2") means that the model is better than v2ray/LLaMA-2-Wizard-70B-QLoRA.

Rank the LLaMA 2 Wizard 70B QLoRA Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 36026 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v2024072803

Support LLM Explorer