Deepseek Llm 7B Chat By deepseek-ai: Benchmarks, Features and Detailed Analysis. Insights on Deepseek Llm 7B Chat.

Autotrain compatible Conversational Endpoints compatible Llama Pytorch Region:us Sharded

Deepseek Llm 7B Chat Benchmarks

ARC: 42.5^-55.9%

HellaSwag: 56.1^-41.1%

MMLU: 44^-49.1%

TruthfulQA: 47.92^-18.8%

WinoGrande: 74.9^-14.4%

GSM8K: 55.6^-39.6%

OpenCompass Avg: 37.1 vs 73.3 (GPT-4) ^-49.4%

Exam: 37.8^-51%

Language: 22.2^-64.2%

Knowledge: 40^-45.6%

Understanding: 31.7^-54.7%

Reasoning: 42.2^-43.3%

^nn.n% — How the model compares to the GPT-4.

Deepseek Llm 7B Chat Parameters and Internals

LLM Name	Deepseek Llm 7B Chat
Repository	Open on 🤗
Model Size	7b
Required VRAM	13.9 GB
Updated	2024-07-27
Maintainer	deepseek-ai
Model Type	llama
Model Files	10.0 GB: 1-of-2 3.9 GB: 2-of-2
Model Architecture	LlamaForCausalLM
License	other
Context Length	4096
Model Max Length	4096
Transformers Version	4.33.1
Tokenizer Class	LlamaTokenizerFast
Beginning of Sentence Token	<｜begin▁of▁sentence｜>
End of Sentence Token	<｜end▁of▁sentence｜>
Vocabulary Size	102400
Torch Data Type	bfloat16

Deepseek Llm 7B Chat (deepseek-ai/deepseek-llm-7b-chat)

Quantized Models of the Deepseek Llm 7B Chat

Model	Likes	Downloads	VRAM
Deepseekq	0	3465	4 GB
Deepseek Llm 7B Chat GGUF	18	2006	3 GB
Deepseek LLM 7B Chat GGUF	3	361	2 GB
Deepseek Llm 7B Chat AWQ	1	31	4 GB
Deepseekq	0	0	4 GB

Best Alternatives to Deepseek Llm 7B Chat

Best Alternatives	HF Rank	Context/RAM	Downloads	Likes
...1M 1000000ctx AEZAKMI 3 1 1702	0.2	1024K / 13.5 GB	296	1
Yarn Llama 2 7B 128K	0.2	128K / 13.5 GB	12746	38
LLaMA 7B PoSE YaRN 128K	0.2	128K / 13.5 GB	28	2
LLaMA 7B PoSE YaRN 96K	0.2	96K / 13.5 GB	11	1
LLaMA 7B PoSE Linear 96K	0.2	96K / 27 GB	11	1
Chat Llama2 7B 80K	0.2	80K / 13.8 GB	11	0
Llama2 7B 80K	0.2	80K / 13.8 GB	8	0
Lloma Step400	0.3	64K / 13.5 GB	294	0
Lloma Step200	0.3	64K / 13.5 GB	298	0
Lloma Step50	0.2	64K / 13.5 GB	297	0

Rank the Deepseek Llm 7B Chat Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 34447 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v2024072501

Support LLM Explorer