WhiteRabbitNeo 33B V1 AWQ by TheBloke

 »  All LLMs  »  TheBloke  »  WhiteRabbitNeo 33B V1 AWQ   URL Share it on

  4-bit   Autotrain compatible   Awq Base model:quantized:whiterabb... Base model:whiterabbitneo/whit...   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow

WhiteRabbitNeo 33B V1 AWQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

WhiteRabbitNeo 33B V1 AWQ Parameters and Internals

Model Type
deepseek
Use Cases
Limitations:
Cannot be used in ways that violate laws or infringe on the rights of others., Cannot be used for military purposes., Cannot be used to exploit, harm, or attempt to harm minors., Cannot be used to generate false or harmful information., Cannot be used for automated decision making that adversely affects legal rights., Cannot be used to discriminate based on certain characteristics.
Input Output
Input Format:Text prompt using a reasoning framework.
Accepted Modalities:
text
Output Format:Logical, multi-step reasoning with explanations.
LLM NameWhiteRabbitNeo 33B V1 AWQ
Repository 🤗https://huggingface.co/TheBloke/WhiteRabbitNeo-33B-v1-AWQ 
Model NameWhiteRabbitNeo 33B v1
Model CreatorWhiteRabbitNeo
Base Model(s)  whiterabbitneo/WhiteRabbitNeo-33B-v1   whiterabbitneo/WhiteRabbitNeo-33B-v1
Model Size33b
Required VRAM18.1 GB
Updated2024-11-12
MaintainerTheBloke
Model Typedeepseek
Model Files  10.0 GB: 1-of-2   8.1 GB: 2-of-2
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length16384
Model Max Length16384
Transformers Version4.36.2
Tokenizer ClassLlamaTokenizer
Padding Token<|end▁of▁sentence|>
Vocabulary Size32256
Torch Data Typefloat16
WhiteRabbitNeo 33B V1 AWQ (TheBloke/WhiteRabbitNeo-33B-v1-AWQ)

Best Alternatives to WhiteRabbitNeo 33B V1 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
...eepseek Coder 33B Instruct AWQ16K / 18.1 GB8476734
Everyone Coder 33B Base AWQ16K / 18.1 GB122
WizardCoder 33B V1.1 AWQ16K / 18.1 GB1185
Deepseek Coder 33B Base AWQ16K / 18.1 GB274
Code 33B AWQ2K / 17.6 GB153
Python Code 33B AWQ2K / 17.6 GB111
Vicuna 33B Coder AWQ2K / 17.6 GB111
Vicuna 33B AWQ2K / 17.6 GB112
Fin Llama 33B AWQ2K / 17.6 GB335
Chronoboros 33B AWQ2K / 17.6 GB122
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/WhiteRabbitNeo-33B-v1-AWQ.

Rank the WhiteRabbitNeo 33B V1 AWQ Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 37901 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241110