LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Airoboros 34B 3.3 by jondurbin

 »  All LLMs  »  jondurbin  »  Airoboros 34B 3.3   URL Share it on

  12   
  Autotrain compatible   Conversational Dataset:bluemoon-fandom-1-1-rp...   Dataset:boolq Dataset:glaiveai/glaive-functi... Dataset:grimulkan/limarp-augme... Dataset:jondurbin/airoboros-3.... Dataset:jondurbin/cinematika-v... Dataset:jondurbin/gutenberg-dp...   Dataset:ldjnr/capybara Dataset:mattpscott/airoboros-s...   Dataset:piqa Dataset:unalignment/toxic-dpo-... Dataset:vezora/tested-22k-pyth...   Endpoints compatible   Llama   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/jondurbin/airoboros-34b-3.3 

Airoboros 34B 3.3 Benchmarks

ARC: 67.41 vs 96.7 (so35)-30.3%
HellaSwag: 84.45 vs 95.3 (gpt4)-11.4%
MMLU: 74.83 vs 88.3 (so35)-15.3%
TruthfulQA: 59.59 vs 59 (gpt4)1%
WinoGrande: 82.08 vs 87.5 (gpt4)-6.2%
GSM8K: 29.72 vs 96.4 (so35)-69.2%
LLME Score: 0.17499
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Airoboros 34B 3.3 (jondurbin/airoboros-34b-3.3)

Airoboros 34B 3.3 Parameters and Internals

Training Details 
Data Sources:
jondurbin/airoboros-3.2, bluemoon-fandom-1-1-rp-cleaned, boolq, jondurbin/gutenberg-dpo-v0.1, LDJnr/Capybara, jondurbin/cinematika-v0.1, glaiveai/glaive-function-calling-v2, grimulkan/LimaRP-augmented, piqa, Vezora/Tested-22k-Python-Alpaca, mattpscott/airoboros-summarization, unalignment/toxic-dpo-v0.2
Context Length:
8000
Input Output 
Input Format:
llama-2 chat
Performance Tips:
Use a very low temperature for more accurate results. Useful techniques for longer responses include detailed prompts with explicit instruction.
LLM NameAiroboros 34B 3.3
Repository 🤗https://huggingface.co/jondurbin/airoboros-34b-3.3 
Base Model(s)  01-ai/yi-34b-200k   01-ai/yi-34b-200k
Model Size34b
Required VRAM68.7 GB
Updated2025-05-31
Maintainerjondurbin
Model Typellama
Model Files  4.0 GB: 1-of-18   3.9 GB: 2-of-18   3.9 GB: 3-of-18   3.9 GB: 4-of-18   3.9 GB: 5-of-18   3.9 GB: 6-of-18   3.9 GB: 7-of-18   3.9 GB: 8-of-18   3.9 GB: 9-of-18   3.9 GB: 10-of-18   3.9 GB: 11-of-18   3.9 GB: 12-of-18   3.9 GB: 13-of-18   3.9 GB: 14-of-18   3.9 GB: 15-of-18   3.9 GB: 16-of-18   3.9 GB: 17-of-18   2.3 GB: 18-of-18
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length200000
Model Max Length200000
Transformers Version4.37.2
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size64000
Torch Data Typebfloat16

Best Alternatives to Airoboros 34B 3.3

Best Alternatives
Context / RAM
Downloads
Likes
Casual Magnum 34B195K / 68.8 GB01
34B Beta195K / 69.2 GB330163
Yi 34B 200K195K / 68.9 GB6739316
Bagel Hermes 34B Slerp195K / 68.9 GB34761
Smaug 34B V0.1195K / 69.2 GB331262
Bagel 34B V0.2195K / 68.7 GB2141
Yi 34B 200K AEZAKMI V2195K / 69.2 GB2412
Smaug 34B V0.1 ExPO195K / 69.2 GB32920
Faro Yi 34B195K / 69.2 GB36886
Bagel DPO 34B V0.5195K / 68.7 GB361917
Note: green Score (e.g. "73.2") means that the model is better than jondurbin/airoboros-34b-3.3.

Rank the Airoboros 34B 3.3 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 47753 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer