Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf By juewang: Benchmarks, Features and Detailed Analysis. Insights on Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf.

8-bit Autotrain compatible Codegen Conversational Endpoints compatible Instruct Llama Region:us Safetensors

Model Card on HF 🤗: https://huggingface.co/juewang/deepseek-coder-1.3b-instruct-trt-int4-g64-hf

Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf Benchmarks

LLME Score: 0.1902

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf (juewang/deepseek-coder-1.3b-instruct-trt-int4-g64-hf)

Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf Parameters and Internals

LLM Name	Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf
Repository 🤗	https://huggingface.co/juewang/deepseek-coder-1.3b-instruct-trt-int4-g64-hf
Model Size	1.3b
Required VRAM	0.9 GB
Updated	2025-02-22
Maintainer	juewang
Model Type	llama
Instruction-Based	Yes
Model Files	0.9 GB
Generates Code	Yes
Model Architecture	LlamaForCausalLM
Context Length	16384
Model Max Length	16384
Transformers Version	4.41.0.dev0
Tokenizer Class	LlamaTokenizer
Padding Token	<｜end▁of▁sentence｜>
Vocabulary Size	32256
Torch Data Type	bfloat16

Best Alternatives to Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf

Best Alternatives	Context / RAM	Downloads	Likes
Deepseek Coder 1.3B Instruct	16K / 2.7 GB	64461	113
...c Deepseek Coder 1.3B Instruct	16K / 5.4 GB	74	0
Speechless Coder Ds 1.3B	16K / 2.7 GB	1868	0
Hpc Coder V2.1.3B	16K / 2.7 GB	131	4
...t Structured Output Peft Merge	16K / 2.7 GB	119	0
Datascience Coder 1.3B	16K / 2.7 GB	71	1
...pseek Coder 1.3B Instruct GPTQ	16K / 0.9 GB	330	6
...epseek Coder 1.3B Instruct AWQ	8K / 0.9 GB	133	2
...Coder 1.3B Function Calling V1	16K / 2.7 GB	442	1

Note: green Score (e.g. "73.2") means that the model is better than juewang/deepseek-coder-1.3b-instruct-trt-int4-g64-hf.

Rank the Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 43470 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v20241227

Support LLM Explorer

Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf by juewang

» All LLMs » juewang » Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf URL Share it on

Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf Benchmarks

Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf Parameters and Internals

Best Alternatives to Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf

Rank the Deepseek Coder 1.3B Instruct Trt Int4 G64 Hf Capabilities

What open-source LLMs or SLMs are you in search of? 43470 in total.