Llama 3.2 3B Instruct QLORA INT4 EO8 by meta-llama

 ยป  All LLMs  ยป  meta-llama  ยป  Llama 3.2 3B Instruct QLORA INT4 EO8   URL Share it on

  Arxiv:2204.05149   Arxiv:2405.16406 Base model:finetune:meta-llama... Base model:meta-llama/llama-3....   De   En   Es   Facebook   Fr   Hi   Instruct   It   Llama   Llama-3   Meta   Pt   Pytorch   Region:us   Th

Llama 3.2 3B Instruct QLORA INT4 EO8 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Llama 3.2 3B Instruct QLORA INT4 EO8 (meta-llama/Llama-3.2-3B-Instruct-QLORA_INT4_EO8)

Llama 3.2 3B Instruct QLORA INT4 EO8 Parameters and Internals

LLM NameLlama 3.2 3B Instruct QLORA INT4 EO8
Repository ๐Ÿค—https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct-QLORA_INT4_EO8 
Base Model(s)  meta-llama/Llama-3.2-3B   meta-llama/Llama-3.2-3B
Model Size3b
Updated2025-02-22
Maintainermeta-llama
Instruction-BasedYes
Supported Languagesen de fr it pt hi es th
Model ArchitectureMambaSSM
Licensellama3.2
Vocabulary Size128256

Best Alternatives to Llama 3.2 3B Instruct QLORA INT4 EO8

Best Alternatives
Context / RAM
Downloads
Likes
...3B Instruct SpinQuant INT4 EO80K /  GB46732

Rank the Llama 3.2 3B Instruct QLORA INT4 EO8 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43508 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227