LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Zephyr Orpo 141B A35b V0.1 GGUF by bartowski

 »  All LLMs  »  bartowski  »  Zephyr Orpo 141B A35b V0.1 GGUF   URL Share it on

  277   
  Autotrain compatible Base model:mistral-community/m... Base model:quantized:mistral-c...   Conversational Dataset:argilla/distilabel-cap...   Endpoints compatible   Generated from trainer   Gguf   Mixtral   Moe   Orpo   Q2   Quantized   Region:us   Trl
Model Card on HF 🤗: https://huggingface.co/bartowski/zephyr-orpo-141b-A35b-v0.1-GGUF 

Zephyr Orpo 141B A35b V0.1 GGUF Benchmarks

LLME Score: 0.18987
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Zephyr Orpo 141B A35b V0.1 GGUF (bartowski/zephyr-orpo-141b-A35b-v0.1-GGUF)

Zephyr Orpo 141B A35b V0.1 GGUF Parameters and Internals

LLM NameZephyr Orpo 141B A35b V0.1 GGUF
Repository 🤗https://huggingface.co/bartowski/zephyr-orpo-141b-A35b-v0.1-GGUF 
Base Model(s)  mistral-community/Mixtral-8x22B-v0.1   mistral-community/Mixtral-8x22B-v0.1
Model Size141b
Required VRAM4.8 GB
Updated2025-02-05
Maintainerbartowski
Model Typemixtral
Model Files  14.9 GB: 1-of-5   15.0 GB: 2-of-5   13.6 GB: 3-of-5   14.8 GB: 4-of-5   6.2 GB: 5-of-5   14.0 GB: 1-of-5   14.5 GB: 2-of-5   13.2 GB: 3-of-5   14.2 GB: 4-of-5   5.6 GB: 5-of-5   13.5 GB: 1-of-5   13.5 GB: 2-of-5   12.3 GB: 3-of-5   13.3 GB: 4-of-5   5.6 GB: 5-of-5   18.8 GB: 1-of-5   18.9 GB: 2-of-5   17.1 GB: 3-of-5   18.4 GB: 4-of-5   7.2 GB: 5-of-5   18.0 GB: 1-of-5   17.8 GB: 2-of-5   16.2 GB: 3-of-5   17.4 GB: 4-of-5   6.9 GB: 5-of-5   11.8 GB: 1-of-5   12.3 GB: 2-of-5   11.2 GB: 3-of-5   12.0 GB: 4-of-5   4.8 GB: 5-of-5   16.5 GB: 1-of-5   17.1 GB: 2-of-5   15.6 GB: 3-of-5   16.8 GB: 4-of-5   6.6 GB: 5-of-5   15.7 GB: 1-of-5   15.9 GB: 2-of-5   14.5 GB: 3-of-5   15.6 GB: 4-of-5   6.2 GB: 5-of-5   14.0 GB: 1-of-5   14.5 GB: 2-of-5   13.2 GB: 3-of-5   14.2 GB: 4-of-5   5.6 GB: 5-of-5   20.0 GB: 1-of-5   19.7 GB: 2-of-5
GGUF QuantizationYes
Quantization Typegguf|q2|q4_k
Model ArchitectureMixtralForCausalLM
Licenseapache-2.0
Context Length65536
Model Max Length65536
Transformers Version4.39.3
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to Zephyr Orpo 141B A35b V0.1 GGUF

Best Alternatives
Context / RAM
Downloads
Likes
...yr Orpo 141B A35b V0.1 Bpw2.2564K / 40 GB41

Rank the Zephyr Orpo 141B A35b V0.1 GGUF Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer