LLM Explorer: A Curated Large Language Model Directory and Analytics  // 

RTLCoder Z GPTQ4bit V1.0 by ishorn5

What open-source LLMs or SLMs are you in search of? 18857 in total.

 ยป  All LLMs  ยป  ishorn5  ยป  RTLCoder Z GPTQ4bit V1.0   URL Share it on

  4bit   Autotrain compatible   Conversational   Endpoints compatible   Gptq   Has space   Mistral   Quantized   Region:us

Rank the RTLCoder Z GPTQ4bit V1.0 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
RTLCoder Z GPTQ4bit V1.0 (ishorn5/RTLCoder-Z-GPTQ4bit-v1.0)

Best Alternatives to RTLCoder Z GPTQ4bit V1.0

Best Alternatives
HF Rank
Snorkel Mistral PairRM DPO66.1832K / 14.4 GB302274
Mini Synatra SFT63.3932K / 15 GB35572
Tess XS V1.3 Yarn 128K62.4932K / 14.5 GB60899
Winterreise M761.8632K / 14.4 GB30381
KoOpenChat Sft58.618K / 15 GB33413
MistralLite51.4532K / 14.4 GB17721412
RTLCoder V1.1 Gptq 4bit32K / 4.2 GB720
Mistral Test GPTQ32K / 4.2 GB150
Slt Flng V01 4bit Gptq8K / 4.2 GB290
Intnt Strlng V02 4bit Gptq8K / 4.2 GB220
Note: green Score (e.g. "73.2") means that the model is better than ishorn5/RTLCoder-Z-GPTQ4bit-v1.0.

RTLCoder Z GPTQ4bit V1.0 Parameters and Internals

LLM NameRTLCoder Z GPTQ4bit V1.0
RepositoryOpen on ๐Ÿค— 
Required VRAM4.2 GB
Model Typemistral
Model Files  4.2 GB
GPTQ QuantizationYes
Quantization Typegptq|4bit
Model ArchitectureMistralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.34.1
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Initializer Range0.02
Torch Data Typefloat16
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024022003