LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Airoboros 33B Gpt4 1 4 SuperHOT 8K GPTQ by TheBloke

 »  All LLMs  »  TheBloke  »  Airoboros 33B Gpt4 1 4 SuperHOT 8K GPTQ   URL Share it on

  30   
  4-bit   Autotrain compatible   Custom code   Ext 8k   Gptq   Llama   Quantized   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/TheBloke/airoboros-33B-gpt4-1-4-SuperHOT-8K-GPTQ 

Airoboros 33B Gpt4 1 4 SuperHOT 8K GPTQ Benchmarks

ARC: 24.66 vs 96.7 (so35)-74.5%
HellaSwag: 31.23 vs 95.3 (gpt4)-67.2%
MMLU: 23.13 vs 88.3 (so35)-73.8%
TruthfulQA: 47.44 vs 59 (gpt4)-19.6%
WinoGrande: 50.43 vs 87.5 (gpt4)-42.4%
LLME Score: 0.16158
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Airoboros 33B Gpt4 1 4 SuperHOT 8K GPTQ (TheBloke/airoboros-33B-gpt4-1-4-SuperHOT-8K-GPTQ)

Airoboros 33B Gpt4 1 4 SuperHOT 8K GPTQ Parameters and Internals

Model Type 
Text Generation
Use Cases 
Areas:
Research
Applications:
AI Development, Chatbots, Text Analysis
Primary Use Cases:
Text generation, Roleplay/chat, Coding tasks
Additional Notes 
Supports multi-line and multi-character conversations. Capable of context-obedient question answering. Format configuration enhances comprehension of commands.
Supported Languages 
English (Full)
Training Details 
Data Sources:
Synthetic data from GPT-4, Rosetta Code Dataset
Methodology:
qLoRA fine-tune
Context Length:
8192
Hardware Used:
4-bit Base Model
Model Architecture:
Quantised Model
Safety Evaluation 
Methodologies:
None specified
Input Output 
Input Format:
BEGININPUT with context metadata and instructions
Accepted Modalities:
Text
Output Format:
Plain text, formatted as specified
Release Notes 
Version:
1.4
Notes:
Increased context size to 8K. Incorporates SuperHOT 8K technique.
LLM NameAiroboros 33B Gpt4 1 4 SuperHOT 8K GPTQ
Repository 🤗https://huggingface.co/TheBloke/airoboros-33B-gpt4-1-4-SuperHOT-8K-GPTQ 
Base Model(s)  Panchovix/airoboros-33b-gpt4-1.2-SuperHOT-8k   Panchovix/airoboros-33b-gpt4-1.2-SuperHOT-8k
Model Size33b
Required VRAM16.9 GB
Updated2025-02-22
MaintainerTheBloke
Model Typellama
Model Files  16.9 GB
GPTQ QuantizationYes
Context Length8k
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length8192
Model Max Length8192
Transformers Version4.30.0.dev0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Airoboros 33B Gpt4 1 4 SuperHOT 8K GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
Everyone Coder 33B Base GPTQ16K / 17.4 GB333
CodeFuse DeepSeek 33B 4bits16K / 18.7 GB5810
WhiteRabbitNeo 33B V1 GPTQ16K / 17.4 GB374
WizardCoder 33B V1.1 GPTQ16K / 17.4 GB3311
...epseek Coder 33B Instruct GPTQ16K / 17.4 GB46726
Deepseek Coder 33B Base GPTQ16K / 17.4 GB892
Sorceroboros 33B S2a4 Gptq8K / 17.6 GB53
...icuna 33B 1 3 SuperHOT 8K GPTQ8K / 16.9 GB3227
...Combined Data SuperHOT 8K GPTQ8K / 18.1 GB144
...se Alpaca 33B SuperHOT 8K GPTQ8K / 17.4 GB1511

Rank the Airoboros 33B Gpt4 1 4 SuperHOT 8K GPTQ Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43508 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer