Llama 3.2 1B Instruct By meta-llama: Benchmarks, Features and Detailed Analysis. Insights on Llama 3.2 1B Instruct.

Assistant-like chat, Knowledge retrieval, Summarization, Mobile AI-powered writing assistants, Query and prompt rewriting, Natural language generation tasks

Primary Use Cases:

Multilingual dialogue use cases

Limitations:

Use in any manner that violates applicable laws or regulations

Additional Notes

Llama 3.2 models can be fine-tuned for additional languages beyond the primary 8 supported languages.

Supported Languages

en (English), de (German), fr (French), it (Italian), pt (Portuguese), hi (Hindi), es (Spanish), th (Thai)

Training Details

Data Sources:

A new mix of publicly available online data.

Data Volume:

Up to 9T tokens

Methodology:

Supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF)

Context Length:

128000

Training Time:

830k GPU hours

Hardware Used:

H100-80GB (TDP of 700W) GPUs

Model Architecture:

Auto-regressive with optimized transformer architecture

Input Output

Input Format:

Multilingual Text

Accepted Modalities:

text

Output Format:

Multilingual Text and code

Release Notes

Version:

3.2

Date:

September 25, 2024

Notes:

Introduced new multilingual capabilities and instruction tuning for agentic and summarization tasks.

LLM Name	Llama 3.2 1B Instruct
Repository 🤗	https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct
Model Size	1b
Required VRAM	2.5 GB
Updated	2025-03-12
Maintainer	meta-llama
Model Type	llama
Instruction-Based	Yes
Model Files	2.5 GB
Supported Languages	en de fr it pt hi es th
Model Architecture	LlamaForCausalLM
License	llama3.2
Context Length	131072
Model Max Length	131072
Transformers Version	4.45.0.dev0
Tokenizer Class	PreTrainedTokenizerFast
Vocabulary Size	128256
Torch Data Type	bfloat16

Quantized Models of the Llama 3.2 1B Instruct

Model	Likes	Downloads	VRAM
...2 1B Instruct Unsloth Bnb 4bit	2	88553	1 GB
Llama 3.2 1B Instruct Bnb 4bit	14	92087	1 GB
Llama Deepsync 1B	12	185	2 GB
Orca Mini V9 1 1B Instruct	3	68	2 GB
...truct Gptqmodel 4bit Vortex V1	2	91	1 GB
Llama SmolTalk 3.2 1B Instruct	11	642	2 GB
OrcaAgent Llama3.2 1B	2	47	2 GB
Regex AI Llama 3.2 1B	0	139	0 GB
...ma 3.2 1B Instruct XMADai 4bit	5	19	1 GB

Best Alternatives to Llama 3.2 1B Instruct

Best Alternatives	Context / RAM	Downloads	Likes
Llama 3.2 1B Instruct	128K / 2.5 GB	168239	66
...enchmaxx Llama 3.2 1B Instruct	128K / 0 GB	284	2
Goppa LogiLlama	128K / 4.9 GB	299	11
... 6 1B Instruct Abliterated LPL	128K / 2.5 GB	67	0
Llama 3.2 1b SunOrca V1	128K / 3 GB	40	0
Llama 3.2 1b OrcaSun V1	128K / 3 GB	26	0
Llama Express.1 Math	128K / 2.5 GB	422	10
Lancer 1 1B Instruct	128K / 2.5 GB	182	1
BunderMaxx 1010	128K / 2.5 GB	14	1
Mini Think Base 1B	128K / 2.5 GB	77	1

Rank the Llama 3.2 1B Instruct Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 44887 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v20241227

Support LLM Explorer

Llama 3.2 1B Instruct by meta-llama

» All LLMs » meta-llama » Llama 3.2 1B Instruct URL Share it on

Llama 3.2 1B Instruct Benchmarks

Llama 3.2 1B Instruct Parameters and Internals

Quantized Models of the Llama 3.2 1B Instruct

Best Alternatives to Llama 3.2 1B Instruct

Rank the Llama 3.2 1B Instruct Capabilities

What open-source LLMs or SLMs are you in search of? 44887 in total.