Deepseek Math 7B Instruct by deepseek-ai

 »  All LLMs  »  deepseek-ai  »  Deepseek Math 7B Instruct   URL Share it on

  Arxiv:2402.03300   Autotrain compatible   Conversational   Endpoints compatible   Instruct   Llama   Pytorch   Region:us   Sharded

Deepseek Math 7B Instruct Benchmarks

Deepseek Math 7B Instruct (deepseek-ai/deepseek-math-7b-instruct)

Deepseek Math 7B Instruct Parameters and Internals

Model Type 
text generation, math problem-solving
Use Cases 
Areas:
research, education
Applications:
solving mathematical problems, providing step-by-step solutions
Primary Use Cases:
math tutoring, academic research
Considerations:
Use chain-of-thought prompts for optimal performance.
Additional Notes 
It's recommended to avoid adding a system prompt for compatibility reasons.
Supported Languages 
en (high proficiency), zh (high proficiency)
Input Output 
Input Format:
Messages structured as JSON objects with user prompts.
Accepted Modalities:
text
Output Format:
Formatted step-by-step solutions with final answer within boxed notation.
Performance Tips:
Use chain-of-thought prompts to improve solution generation.
LLM NameDeepseek Math 7B Instruct
Repository 🤗https://huggingface.co/deepseek-ai/deepseek-math-7b-instruct 
Model Size7b
Required VRAM13.9 GB
Updated2024-12-22
Maintainerdeepseek-ai
Model Typellama
Instruction-BasedYes
Model Files  10.0 GB: 1-of-2   3.9 GB: 2-of-2
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length4096
Model Max Length4096
Transformers Version4.33.1
Tokenizer ClassLlamaTokenizerFast
Beginning of Sentence Token<|begin▁of▁sentence|>
End of Sentence Token<|end▁of▁sentence|>
Vocabulary Size102400
Torch Data Typebfloat16

Quantized Models of the Deepseek Math 7B Instruct

Model
Likes
Downloads
VRAM
...epseek Math 7B Instruct AWQ Q40124 GB
Deepseek Math 7B Instruct GPTQ0174 GB
Deepseek Math 7B Instruct GGUF1602 GB

Best Alternatives to Deepseek Math 7B Instruct

Best Alternatives
Context / RAM
Downloads
Likes
... Qwen2.5llamaify 7B V23.1 200K195K / 15.2 GB29350
SuperNeuralDreadDevil 8B128K / 16.1 GB1551
Falcon3 7B Instruct32K / 14.8 GB411428
Falcon3 7B Instruct 1.58bit32K / 3.3 GB44113
FalconSlerp2 7B32K / 14.9 GB60
Llama 2 7B 32K Instruct32K / 13.5 GB6101159
Qwen2 7B Instruct Llama32K / 15.2 GB113
Qwen2 7B Instruct Mistral32K / 15.2 GB141
AIRIC The Mistral32K / 14.4 GB7507
...ls Vikhr 7B Instruct 0.4 4bits32K / 5.2 GB100
Note: green Score (e.g. "73.2") means that the model is better than deepseek-ai/deepseek-math-7b-instruct.

Rank the Deepseek Math 7B Instruct Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40066 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217