Deepseek Llm 7B Base GPTQ By TheBloke: Benchmarks, Features and Detailed Analysis. Insights on Deepseek Llm 7B Base GPTQ.

4-bit Autotrain compatible Base model:deepseek-ai/deepsee... Base model:quantized:deepseek-... Gptq Llama Quantized Region:us Safetensors

Deepseek Llm 7B Base GPTQ Parameters and Internals

LLM Name	Deepseek Llm 7B Base GPTQ
Repository	Open on 🤗
Model Name	Deepseek LLM 7B Base
Model Creator	DeepSeek
Base Model(s)	Deepseek Llm 7B Base deepseek-ai/deepseek-llm-7b-base
Model Size	7b
Required VRAM	4.8 GB
Updated	2024-07-27
Maintainer	TheBloke
Model Type	deepseek
Model Files	4.8 GB
GPTQ Quantization	Yes
Quantization Type	gptq
Model Architecture	LlamaForCausalLM
License	other
Context Length	4096
Model Max Length	4096
Transformers Version	4.35.2
Tokenizer Class	LlamaTokenizerFast
Beginning of Sentence Token	<｜begin▁of▁sentence｜>
End of Sentence Token	<｜end▁of▁sentence｜>
Vocabulary Size	102400
Torch Data Type	bfloat16

Deepseek Llm 7B Base GPTQ (TheBloke/deepseek-llm-7B-base-GPTQ)

Best Alternatives to Deepseek Llm 7B Base GPTQ

Best Alternatives	HF Rank	Context/RAM	Downloads	Likes
Yarn Llama 2 7B 128K GPTQ	0.2	128K / 3.9 GB	23	7
Yarn Llama 2 7B 64K GPTQ	0.2	64K / 3.9 GB	10	1
... 7B 32K Instructions V4 Marlin	0.2	32K / 4.1 GB	26	0
Aixcoder 7B GPTQ	0.2	32K / 4.5 GB	6	1
Calm2 7B Chat GPTQ	0.2	32K / 4.4 GB	13	6
...Calm2 7B Chat GPTQ Calib Ja 1K	0.2	32K / 4.4 GB	10	5
Llama 2 7B 32K Instruct GPTQ	0.2	32K / 3.9 GB	60	27
CodeLlama 7B Instruct GPTQ	0.2	16K / 3.9 GB	53579	42
Codebear 7B 4bit	0.2	16K / 3.9 GB	10	1
...a 7B Instruct GPTQ Calib Ja 1K	0.2	16K / 3.9 GB	9	0

Note: green Score (e.g. "73.2") means that the model is better than TheBloke/deepseek-llm-7B-base-GPTQ.

Rank the Deepseek Llm 7B Base GPTQ Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 34446 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v2024072501

Support LLM Explorer

Deepseek Llm 7B Base GPTQ by TheBloke

» All LLMs » TheBloke » Deepseek Llm 7B Base GPTQ URL Share it on

Deepseek Llm 7B Base GPTQ Parameters and Internals

Best Alternatives to Deepseek Llm 7B Base GPTQ

Rank the Deepseek Llm 7B Base GPTQ Capabilities

What open-source LLMs or SLMs are you in search of? 34446 in total.