WizardCoder 15B V1.1 4bit by GodRain

 ยป  All LLMs  ยป  GodRain  ยป  WizardCoder 15B V1.1 4bit   URL Share it on

  Arxiv:2304.12244   4bit   Autotrain compatible Dataset:wizardlm/wizardlm evol...   En   Endpoints compatible   Gptq   Instruct   License:bigcode-openrail-m   Llama   Quantized   Region:us

Rank the WizardCoder 15B V1.1 4bit Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
WizardCoder 15B V1.1 4bit (GodRain/WizardCoder-15B-V1.1-4bit)

Best Alternatives to WizardCoder 15B V1.1 4bit

Best Alternatives
HF Rank
L3 Aethora 15B V2 EXL2 4.0bpw8K / 8.4 GB181
L3 Aethora 15B V2 EXL2 5.0bpw8K / 10.2 GB71
L3 Aethora 15B V2 EXL2 6.0bpw8K / 11.9 GB131
L3 Aethora 15B V2 EXL2 8.0bpw8K / 12.4 GB111
Llama 3 15B Instruct Ft V2 AWQ8K / 9.4 GB70
Meta Llama 3 15B Instruct8K / 23.9 GB4931
LLaMa 3 Stheno V3.2 15B8K / 30 GB275
L3 Aethora 15B V28K / 30.1 GB31535
Llama 3 15B Instruct Ft V28K / 30.1 GB7084
L3 NA Aethora 15B8K / 30.1 GB73

WizardCoder 15B V1.1 4bit Parameters and Internals

LLM NameWizardCoder 15B V1.1 4bit
RepositoryOpen on ๐Ÿค— 
Model Size15b
Required VRAM7.3 GB
Model Typellama
Model Files  7.3 GB
Supported Languagesen
GPTQ QuantizationYes
Quantization Typegptq|4bit
Model ArchitectureLlamaForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.30.2
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32001
Initializer Range0.02
Torch Data Typefloat16

What open-source LLMs or SLMs are you in search of? 36243 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801