Tiny Llm Sft 76M Llama By wdndev: Benchmarks, Features and Detailed Analysis. Insights on Tiny Llm Sft 76M Llama.

Autotrain compatible Chat Custom code Pytorch Region:us Tinyllm Zh

Model Card on HF 🤗: https://huggingface.co/wdndev/tiny_llm_sft_76m_llama

Tiny Llm Sft 76m Llama Benchmarks

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Tiny Llm Sft 76M Llama (wdndev/tiny_llm_sft_76m_llama)

Tiny Llm Sft 76M Llama Parameters and Internals

Model Type

text generation, chat

Additional Notes

The first priority was to complete the large model workflow rather than achieving high-quality fine-tuning.

Supported Languages

Chinese (High)

Training Details

Data Sources:

Chinese Wikipedia

Data Volume:

9 billion tokens

Methodology:

pre-training -> instruction fine-tuning -> human alignment

Model Architecture:

RMSNorm, RoPE, MHA

LLM Name	Tiny Llm Sft 76m Llama
Repository 🤗	https://huggingface.co/wdndev/tiny_llm_sft_76m_llama
Model Size	76m
Required VRAM	0.2 GB
Updated	2025-02-22
Maintainer	wdndev
Model Type	tinyllm
Model Files	0.2 GB
Supported Languages	zh
Model Architecture	TinyllmForCausalLM
Context Length	1024
Model Max Length	1024
Transformers Version	4.38.1
Tokenizer Class	LlamaTokenizer
Vocabulary Size	49958
Torch Data Type	float16

Rank the Tiny Llm Sft 76M Llama Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 43470 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v20241227

Support LLM Explorer

Tiny Llm Sft 76M Llama by wdndev

» All LLMs » wdndev » Tiny Llm Sft 76M Llama URL Share it on

Tiny Llm Sft 76m Llama Benchmarks

Tiny Llm Sft 76M Llama Parameters and Internals

Rank the Tiny Llm Sft 76M Llama Capabilities

What open-source LLMs or SLMs are you in search of? 43470 in total.