34B Beta GGUF by MaziyarPanahi

 ยป  All LLMs  ยป  MaziyarPanahi  ยป  34B Beta GGUF   URL Share it on

  2-bit   3-bit   4-bit   5-bit   6-bit   8-bit   Autotrain compatible   Base model:causallm/34b-beta Base model:quantized:causallm/...   Conversational   Endpoints compatible   Gguf   Llama   Mistral   Quantized   Region:us   Safetensors

34B Beta GGUF Benchmarks

nn.n% โ€” How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Sponsored by Nebius

34B Beta GGUF Parameters and Internals

Model Type 
text-generation, conversational
LLM Name34B Beta GGUF
Repository ๐Ÿค—https://huggingface.co/MaziyarPanahi/34b-beta-GGUF 
Model Name34b-beta-GGUF
Model CreatorCausalLM
Base Model(s)  34B Beta   CausalLM/34b-beta
Model Size34b
Required VRAM12.8โ€ฏGB
Updated2025-02-15
MaintainerMaziyarPanahi
Model Typemistral
Model Files  12.8 GB   18.1 GB   16.7 GB   15.0 GB   20.7 GB   19.6 GB   24.3 GB   23.7 GB   28.2 GB   36.5 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel

Best Alternatives to 34B Beta GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Mergekit Slerp Fecxcxs GGUF0K / 8.4โ€‰GB620
...gekit Passthrough Zpfenfn GGUF0K / 8.7โ€‰GB120
Yi 1.5 34B Chat GGUF0K / 12.8โ€‰GB905
Tess 34B V1.5B GGUF0K / 12.8โ€‰GB10375
Yi 34B Chat GGUF0K / 14.6โ€‰GB244870
Nous Capybara 34B GGUF0K / 14.6โ€‰GB1672166
StructLM 34B GGUF0K / 12.5โ€‰GB1692
Nous Hermes 2 Yi 34B GGUF0K / 14.6โ€‰GB98641
...ous Capybara Limarpv3 34B GGUF0K / 14.6โ€‰GB69929
...4B 200K DARE Megamerge V8 GGUF0K / 9.3โ€‰GB67613
Note: green Score (e.g. "73.2") means that the model is better than MaziyarPanahi/34b-beta-GGUF.

Rank the 34B Beta GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
โ—โ—โ—โ—
Factuality and Completeness of Knowledge  
โ—โ—โ—โ—
Censorship and Alignment  
โ—โ—โ—โ—
Data Analysis and Insight Generation  
โ—โ—โ—โ—
Text Generation  
โ—โ—โ—โ—
Text Summarization and Feature Extraction  
โ—โ—โ—โ—
Code Generation  
โ—โ—โ—โ—
Multi-Language Support and Translation  
โ—โ—โ—โ—

What open-source LLMs or SLMs are you in search of? 43137 in total.

Our Social Media โ†’  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227