Tiny Llm Sft 92M By wdndev: Benchmarks, Features and Detailed Analysis. Insights on Tiny Llm Sft 92M.

Autotrain compatible Chat Conversational Custom code Region:us Safetensors Tinyllm Zh

Model Card on HF 🤗: https://huggingface.co/wdndev/tiny_llm_sft_92m

Tiny Llm Sft 92m Benchmarks

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Tiny Llm Sft 92M (wdndev/tiny_llm_sft_92m)

Tiny Llm Sft 92M Parameters and Internals

Model Type

text generation, chat

Use Cases

Limitations:

Low scores in evaluation due to resource constraints, Some generation errors

Considerations:

Main priority is to go through the entire process of large model training rather than achieving top performance.

Additional Notes

The project aims to run through the entire large model process due to resource constraints.

Supported Languages

Chinese (proficient)

Training Details

Data Sources:

taobao, wikipedia, open source datasets

Data Volume:

approximately 9B tokens

Methodology:

RMSNorm, RoPE, MHA

Model Architecture:

RMSNorm, RoPE, MHA

Input Output

Input Format:

Accepted Modalities:

text

Output Format:

text

LLM Name	Tiny Llm Sft 92m
Repository 🤗	https://huggingface.co/wdndev/tiny_llm_sft_92m
Model Size	92m
Required VRAM	0.2 GB
Updated	2025-02-22
Maintainer	wdndev
Model Type	tinyllm
Model Files	0.2 GB
Supported Languages	zh
Model Architecture	TinyllmForCausalLM
Context Length	1024
Model Max Length	1024
Transformers Version	4.38.2
Tokenizer Class	ChatGLMTokenizer
Padding Token	<unk>
Vocabulary Size	64798
Torch Data Type	float16

Rank the Tiny Llm Sft 92M Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 43470 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v20241227

Support LLM Explorer

Tiny Llm Sft 92M by wdndev

» All LLMs » wdndev » Tiny Llm Sft 92M URL Share it on

Tiny Llm Sft 92m Benchmarks

Tiny Llm Sft 92M Parameters and Internals

Rank the Tiny Llm Sft 92M Capabilities

What open-source LLMs or SLMs are you in search of? 43470 in total.