LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

UNA ThePitbull 21.4B V2 by fblgit

 »  All LLMs  »  fblgit  »  UNA ThePitbull 21.4B V2   URL Share it on

  43   
  Autotrain compatible   Conversational   Dataset:jondurbin/py-dpo-v0.1 Dataset:mlabonne/orpo-dpo-mix-... Dataset:replete-ai/code bagel ...   Endpoints compatible   Juanako   Llama   Model-index   Region:us   Safetensors   Sharded   Tensorflow   Una
Model Card on HF 🤗: https://huggingface.co/fblgit/UNA-ThePitbull-21.4B-v2 

UNA ThePitbull 21.4B V2 Benchmarks

MMLU Pro: 27.95
GPQA: 6.94
MUSR: 6.42
BBH: 46.79
IFEval: 37.9 vs 88 (so35)-56.9%
ARC: 77.73 vs 96.7 (so35)-19.6%
HellaSwag: 91.79 vs 95.3 (gpt4)-3.7%
MMLU: 68.25 vs 88.3 (so35)-22.7%
TruthfulQA: 78.24 vs 59 (gpt4)32.6%
WinoGrande: 87.37 vs 87.5 (gpt4)-0.1%
GSM8K: 63.53 vs 96.4 (so35)-34.1%
MATH Lvl 5: 12.16
LLME Score: 0.26092
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
UNA ThePitbull 21.4B V2 (fblgit/UNA-ThePitbull-21.4B-v2)

UNA ThePitbull 21.4B V2 Parameters and Internals

Model Type 
text-generation
Use Cases 
Areas:
text generation
Additional Notes 
This model is claimed to not be poisoned and offers EQ & IQ in a smart and conversational manner.
Training Details 
Data Sources:
mlabonne/orpo-dpo-mix-40k, jondurbin/py-dpo-v0.1, Replete-AI/code_bagel_hermes-2.5
Data Volume:
Unknown
Methodology:
SFT with `Replete-AI/code_bagel_hermes-2.5` and DPO with `mlabonne/orpo-dpo-mix-40k`, `jondurbin/py-dpo-v0.1`
Context Length:
2048
Training Time:
Unknown
Model Architecture:
Unknown
Release Notes 
Version:
V2
Date:
Unknown
Notes:
Implemented a different UNA strategy covering MLP's and Attention Layers. Performed further SFT and DPO over V1.
LLM NameUNA ThePitbull 21.4B V2
Repository 🤗https://huggingface.co/fblgit/UNA-ThePitbull-21.4B-v2 
Model Size21.4b
Required VRAM43 GB
Updated2025-02-22
Maintainerfblgit
Model Typellama
Model Files  4.8 GB: 1-of-9   4.9 GB: 2-of-9   5.0 GB: 3-of-9   5.0 GB: 4-of-9   4.9 GB: 5-of-9   5.0 GB: 6-of-9   5.0 GB: 7-of-9   4.9 GB: 8-of-9   3.5 GB: 9-of-9
Model ArchitectureLlamaForCausalLM
Licenseafl-3.0
Context Length32768
Model Max Length32768
Transformers Version4.40.2
Is Biased0
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size92544
Torch Data Typebfloat16

Best Alternatives to UNA ThePitbull 21.4B V2

Best Alternatives
Context / RAM
Downloads
Likes
Luxia 21.4B Alignment V1.232K / 43 GB55539
Luxia 21.4B Alignment V1.032K / 42.8 GB968633
Final Model Test V232K / 43 GB100
DPO Model Test132K / 43 GB50
UNA ThePitbull 21.4 V132K / 43 GB195
Sft Model Test132K / 43 GB100
Merge Model Test232K / 42.8 GB80
Merge Model Test132K / 42.8 GB60
Sft Model Test032K / 43 GB70
All DPO Model Test132K / 43 GB70
Note: green Score (e.g. "73.2") means that the model is better than fblgit/UNA-ThePitbull-21.4B-v2.

Rank the UNA ThePitbull 21.4B V2 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer