WizardLM 13B Uncensored 4bit 128g by 4bit

 ยป  All LLMs  ยป  4bit  ยป  WizardLM 13B Uncensored 4bit 128g   URL Share it on

  4bit   Autotrain compatible   Endpoints compatible   Llama   Quantized   Region:us   Uncensored

WizardLM 13B Uncensored 4bit 128g Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

WizardLM 13B Uncensored 4bit 128g Parameters and Internals

LLM NameWizardLM 13B Uncensored 4bit 128g
Repository ๐Ÿค—https://huggingface.co/4bit/WizardLM-13B-Uncensored-4bit-128g 
Model Size13b
Required VRAM7.5 GB
Updated2024-09-16
Maintainer4bit
Model Typellama
Model Files  7.5 GB   0.0 GB
Quantization Type4bit
Model ArchitectureLlamaForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.29.0.dev0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32001
Torch Data Typefloat16
WizardLM 13B Uncensored 4bit 128g (4bit/WizardLM-13B-Uncensored-4bit-128g)

Best Alternatives to WizardLM 13B Uncensored 4bit 128g

Best Alternatives
Context / RAM
Downloads
Likes
...1.0 Uncensored SuperHOT 8K TGI8K / 7.3 GB80
...3B Uncensored SuperHOT 8K Fp168K / 26 GB2118
....0 Uncensored SuperHOT 8K Fp168K / 26 GB96
...ed Jordan 13B Bnb 4bit Smashed4K / 7.8 GB60
Llama2 13b Chat Uncensored4K / 52.1 GB1213
Llama2 13b Chat Uncensored2K / 52.1 GB60
...Maid V3 13B 32K 6.0bpw H6 EXL232K / 10 GB61
...Maid V3 13B 32K 8.0bpw H8 EXL232K / 13.2 GB41
WhiteRabbitNeo 13B V116K / 26 GB1441380
CodeLlama 13B Python Fp1616K / 26 GB143725
Note: green Score (e.g. "73.2") means that the model is better than 4bit/WizardLM-13B-Uncensored-4bit-128g.

Rank the WizardLM 13B Uncensored 4bit 128g Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 35941 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072803