LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Bagel 34B V0.5 by jondurbin

 »  All LLMs  »  jondurbin  »  Bagel 34B V0.5   URL Share it on

  22   
  Autotrain compatible   Conversational   Dataset:ai2 arc Dataset:allenai/ultrafeedback ... Dataset:argilla/distilabel-int... Dataset:b-mc2/sql-create-conte... Dataset:bluemoon-fandom-1-1-rp...   Dataset:boolq   Dataset:cakiki/rosetta-code   Dataset:camel-ai/biology   Dataset:camel-ai/chemistry   Dataset:camel-ai/math   Dataset:camel-ai/physics   Dataset:codeparrot/apps   Dataset:facebook/belebele Dataset:glaiveai/glaive-functi... Dataset:grimulkan/limarp-augme... Dataset:jondurbin/airoboros-3.... Dataset:jondurbin/cinematika-v... Dataset:jondurbin/contextual-d... Dataset:jondurbin/gutenberg-dp...   Dataset:jondurbin/py-dpo-v0.1 Dataset:jondurbin/truthy-dpo-v...   Dataset:kingbri/pippa-sharegpt   Dataset:ldjnr/capybara   Dataset:lmsys/lmsys-chat-1m Dataset:mattpscott/airoboros-s... Dataset:migtissera/synthia-v1.... Dataset:muennighoff/natural-in...   Dataset:open-orca/slimorca   Dataset:openbookqa Dataset:parisneo/lollms aware ...   Dataset:piqa   Dataset:ropes   Dataset:squad v2   Dataset:tiger-lab/mathinstruct Dataset:unalignment/toxic-dpo-... Dataset:vezora/tested-22k-pyth... Dataset:whiterabbitneo/wrn-cha... Dataset:whiterabbitneo/wrn-cha...   Dataset:winogrande Dataset:wizardlm/wizardlm evol...   Endpoints compatible   Instruct   Llama   Region:us   Safetensors   Sharded   Tensorflow

Bagel 34B V0.5 Benchmarks

ARC: 67.92 vs 96.7 (so35)-29.8%
HellaSwag: 83.36 vs 95.3 (gpt4)-12.5%
MMLU: 75.82 vs 88.3 (so35)-14.1%
TruthfulQA: 60.63 vs 59 (gpt4)2.8%
WinoGrande: 82.24 vs 87.5 (gpt4)-6%
GSM8K: 56.25 vs 96.4 (so35)-41.6%
LLME Score: 0.20242
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Bagel 34B V0.5 Parameters and Internals

Model Type 
language model, fine-tuned model
Additional Notes 
The model supports various prompt formats including Llama-2 chat, Alpaca, Vicuna, and ChatML. It is aimed at providing detailed and context-specific answers.
Training Details 
Data Sources:
ai2_arc, allenai/ultrafeedback_binarized_cleaned, argilla/distilabel-intel-orca-dpo-pairs, jondurbin/airoboros-3.2, codeparrot/apps, facebook/belebele, bluemoon-fandom-1-1-rp-cleaned, boolq, camel-ai/biology, camel-ai/chemistry, camel-ai/math, camel-ai/physics, jondurbin/contextual-dpo-v0.1, jondurbin/gutenberg-dpo-v0.1, jondurbin/py-dpo-v0.1, jondurbin/truthy-dpo-v0.1, LDJnr/Capybara, jondurbin/cinematika-v0.1, WizardLM/WizardLM_evol_instruct_70k, glaiveai/glaive-function-calling-v2, jondurbin/gutenberg-dpo-v0.1, grimulkan/LimaRP-augmented, lmsys/lmsys-chat-1m, ParisNeo/lollms_aware_dataset, TIGER-Lab/MathInstruct, Muennighoff/natural-instructions, openbookqa, kingbri/PIPPA-shareGPT, piqa, Vezora/Tested-22k-Python-Alpaca, ropes, cakiki/rosetta-code, Open-Orca/SlimOrca, b-mc2/sql-create-context, squad_v2, mattpscott/airoboros-summarization, migtissera/Synthia-v1.3, unalignment/toxic-dpo-v0.2, WhiteRabbitNeo/WRN-Chapter-1, WhiteRabbitNeo/WRN-Chapter-2, winogrande
Methodology:
fine-tuned version of Yi-34B-200K with better long-context support
Context Length:
200000
Input Output 
Input Format:
Chat-based input
Accepted Modalities:
text
Output Format:
Text-based response
LLM NameBagel 34B V0.5
Repository 🤗https://huggingface.co/jondurbin/bagel-34b-v0.5 
Base Model(s)  01-ai/yi-34b-200k   01-ai/yi-34b-200k
Model Size34b
Required VRAM68.7 GB
Updated2024-11-21
Maintainerjondurbin
Model Typellama
Instruction-BasedYes
Model Files  4.0 GB: 1-of-18   3.9 GB: 2-of-18   3.9 GB: 3-of-18   3.9 GB: 4-of-18   3.9 GB: 5-of-18   3.9 GB: 6-of-18   3.9 GB: 7-of-18   3.9 GB: 8-of-18   3.9 GB: 9-of-18   3.9 GB: 10-of-18   3.9 GB: 11-of-18   3.9 GB: 12-of-18   3.9 GB: 13-of-18   3.9 GB: 14-of-18   3.9 GB: 15-of-18   3.9 GB: 16-of-18   3.9 GB: 17-of-18   2.3 GB: 18-of-18
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length200000
Model Max Length200000
Transformers Version4.39.0
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size64000
Torch Data Typebfloat16
Bagel 34B V0.5 (jondurbin/bagel-34b-v0.5)

Best Alternatives to Bagel 34B V0.5

Best Alternatives
Context / RAM
Downloads
Likes
Bagel DPO 34B V0.5195K / 68.7 GB287317
Dolphin 2.2 Yi 34B 200K195K / 69.2 GB176635
Bagel 34B V0.4195K / 68.7 GB510
...gpt 32K Codellama 34B Instruct32K / 67.5 GB8692
CodeLlama 34B Instruct Hf16K / 67.5 GB12497278
Speechless Codellama 34B V2.016K / 67.5 GB140017
CodeLlama 34B Instruct Hf16K / 67.5 GB367413
Speechless Codellama 34B V1.916K / 67.5 GB13870
Dolphin 2 2 Yi 34B16K / 68.9 GB4092
XAgentLLaMa 34B Preview16K / 157.3 GB233
Note: green Score (e.g. "73.2") means that the model is better than jondurbin/bagel-34b-v0.5.

Rank the Bagel 34B V0.5 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 38149 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241110
  Support LLM Explorer