TinyLlama 1.1B Intermediate Step 1431K 3T By TinyLlama: Benchmarks, Features and Detailed Analysis. Insights on TinyLlama 1.1B Intermediate Step 1431K 3T.

Autotrain compatible Dataset:bigcode/starcoderdata Dataset:cerebras/slimpajama-62... En Endpoints compatible Llama Model-index Pytorch Region:us Safetensors

TinyLlama 1.1B Intermediate Step 1431K 3T Benchmarks

ARC: 33.87 vs 96.7 (so35)^-65%

HellaSwag: 60.31 vs 95.3 (gpt4)^-36.7%

MMLU: 26.04 vs 88.3 (so35)^-70.5%

TruthfulQA: 37.32 vs 59 (gpt4)^-36.7%

WinoGrande: 59.51 vs 87.5 (gpt4)^-32%

GSM8K: 1.44 vs 96.4 (so35)^-98.5%

LLME Score: 0.31859

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

TinyLlama 1.1B Intermediate Step 1431K 3T Parameters and Internals

LLM Name	TinyLlama 1.1B Intermediate Step 1431K 3T
Repository 🤗	https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
Model Size	1.1b
Required VRAM	4.4 GB
Updated	2024-10-11
Maintainer	TinyLlama
Model Type	llama
Model Files	4.4 GB 4.4 GB
Supported Languages	en
Model Architecture	LlamaForCausalLM
License	apache-2.0
Context Length	2048
Model Max Length	2048
Transformers Version	4.31.0.dev0
Tokenizer Class	LlamaTokenizer
Beginning of Sentence Token	<s>
End of Sentence Token	</s>
Unk Token	<unk>
Vocabulary Size	32000
Torch Data Type	float32

TinyLlama 1.1B Intermediate Step 1431K 3T (TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T)

Quantized Models of the TinyLlama 1.1B Intermediate Step 1431K 3T

Model	Likes	Downloads	VRAM
Bachinstruct	0	161	0 GB
...ntermediate Step 1431K 3T GGUF	5	983	0 GB

Best Alternatives to TinyLlama 1.1B Intermediate Step 1431K 3T

Best Alternatives	Context / RAM	Downloads	Likes
Coven Tiny 1.1b 32k Orpo Alpha	32K / 2.2 GB	6	2
Test Mix 01	32K / 2.2 GB	7	0
Palmer Merge Test 5	32K / 2.2 GB	8	0
TinyLlama 1.1B 32K Instruct	32K / 2.2 GB	1543	12
...llama 1.1B 16K Instructions V4	32K / 2.2 GB	6	0
TinyLlama 1.1B 32K	32K / 2.2 GB	62	28
...lama 1.1B 16K Instructions Rag	32K / 2.2 GB	64	0
Palmer 002 32K	32K / 2.2 GB	13	0
TinyJ.O.S.I.E. 1.1B 32K Base	32K / 2.2 GB	18	1
TinyJ.O.S.I.E. 1.1B 32K Base	32K / 2.2 GB	5	1

Rank the TinyLlama 1.1B Intermediate Step 1431K 3T Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 36726 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v2024072803

Support LLM Explorer