Nanbeige 16B Chat By Nanbeige: Benchmarks, Features and Detailed Analysis. Insights on Nanbeige 16B Chat.

Autotrain compatible Custom code En Endpoints compatible Llama Nanbeige Region:us Safetensors Sharded Tensorflow Zh

Model Card on HF 🤗: https://huggingface.co/Nanbeige/Nanbeige-16B-Chat

Nanbeige 16B Chat Benchmarks

ARC: 91.2 vs 96.7 (so35)^-5.7%

HellaSwag: 75.8 vs 95.3 (gpt4)^-20.5%

MMLU: 59.3 vs 88.3 (so35)^-32.8%

GSM8K: 49.8 vs 96.4 (so35)^-48.3%

OpenCompas: 56.2 vs 73.3 (gpt4)^-23.3%

Exam: 70.5 vs 77.2 (gpt4)^-8.7%

Language: 39.5 vs 62 (gpt4)^-36.3%

Knowledge: 54.3 vs 73.5 (gpt4)^-26.1%

Understand: 67.2 vs 70 (gpt4)^-4%

Reasoning: 53.4 vs 74.4 (gpt4)^-28.2%

LLME Score: 0.1553

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

🌟 Advertise your project 🚀

Nanbeige 16B Chat Parameters and Internals

Model Type

text-generation, chat

Use Cases

Areas:

Research, Commercial applications (with license)

Applications:

Text generation, Dialogue systems

Primary Use Cases:

Chat dialogue, possibly others based on fine-tuning and continuation work

Limitations:

Potential for biased or unexpected outputs

Considerations:

Model's size and probabilistic nature.

Additional Notes

Contact via the provided email to apply for commercial usage licensing.

Supported Languages

en (English), zh (Chinese)

Training Details

Data Sources:

Large amount of high-quality internet corpus, Various books, Code and other desensitized text

Data Volume:

2.5T Tokens

Methodology:

YaRN interpolation method, human-aligned training

Responsible Ai Considerations

Mitigation Strategies:

Ensuring outputs meet ethical and legal requirements to minimize bias and harmful content.

Input Output

Input Format:

Expected input for chat dialogue

Accepted Modalities:

text

Output Format:

Text output

LLM Name	Nanbeige 16B Chat
Repository 🤗	https://huggingface.co/Nanbeige/Nanbeige-16B-Chat
Model Size	16b
Required VRAM	31.6 GB
Updated	2024-12-02
Maintainer	Nanbeige
Model Type	llama
Model Files	4.9 GB: 1-of-7 4.9 GB: 2-of-7 4.9 GB: 3-of-7 5.0 GB: 4-of-7 5.0 GB: 5-of-7 4.9 GB: 6-of-7 2.0 GB: 7-of-7
Supported Languages	en zh
Model Architecture	LlamaForCausalLM
License	other
Context Length	4096
Model Max Length	4096
Transformers Version	4.35.0
Tokenizer Class	NanbeigeTokenizer
Beginning of Sentence Token	<s>
End of Sentence Token	</s>
Unk Token	<unk>
Vocabulary Size	59392
Torch Data Type	bfloat16

Nanbeige 16B Chat (Nanbeige/Nanbeige-16B-Chat)

Quantized Models of the Nanbeige 16B Chat

Model	Likes	Downloads	VRAM
Nanbeige 16B Chat GGUF	1	255	6 GB
Nanbeige 16B Chat GPTQ	1	12	9 GB

Best Alternatives to Nanbeige 16B Chat

Best Alternatives	Context / RAM	Downloads	Likes
Phi 3.5 Mini Investigator 16B	128K / 7.6 GB	15	0
...o Sft Ties Post Merge Auto DPO	8K / 141.2 GB	6	0
Nanbeige2 16B Chat	4K / 31.6 GB	1199	0
...ALAXY V03 Slimorca 1 Epoch 50k	4K / 31.8 GB	90	0
...ca 1 Epoch 50k DPO 1 Epoch 30k	4K / 31.8 GB	68	0
Nanbeige 16B Base Llama	4K / 31.6 GB	1276	3
GALAXY XB V.03	4K / 31.9 GB	72	0
FusionNet SOLAR	4K / 31.9 GB	1303	1
Llama 2 16B Nastychat	4K / 32.4 GB	1300	8
Vinallama 16B Chat Franken	4K / 31.6 GB	11	1

Note: green Score (e.g. "73.2") means that the model is better than Nanbeige/Nanbeige-16B-Chat.

Rank the Nanbeige 16B Chat Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 38765 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v20241124

Support LLM Explorer