LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Qwen1.5 22B Chat Merge GGUF by DisOOM

 »  All LLMs  »  DisOOM  »  Qwen1.5 22B Chat Merge GGUF   URL Share it on

  18   
  Merged Model   2-bit   3-bit   4-bit   5-bit   6-bit   8-bit   Autotrain compatible   Conversational   Endpoints compatible   Gguf   Pytorch   Q4   Quantized   Qwen2   Region:us
Model Card on HF 🤗: https://huggingface.co/DisOOM/Qwen1.5-22B-Chat-Merge-GGUF 

Qwen1.5 22B Chat Merge GGUF Benchmarks

LLME Score: 0.17331
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Qwen1.5 22B Chat Merge GGUF (DisOOM/Qwen1.5-22B-Chat-Merge-GGUF)

Qwen1.5 22B Chat Merge GGUF Parameters and Internals

Model Type 
text-generation, conversational
Additional Notes 
The model suffered from broken implementations when using certain k quantized methods, hence there's no k quantized models available.
LLM NameQwen1.5 22B Chat Merge GGUF
Repository 🤗https://huggingface.co/DisOOM/Qwen1.5-22B-Chat-Merge-GGUF 
Merged ModelYes
Model Size22b
Required VRAM12.6 GB
Updated2025-02-05
MaintainerDisOOM
Model Typeqwen2
Model Files  12.6 GB   15.3 GB   23.4 GB
GGUF QuantizationYes
Quantization Typegguf|q4
Model ArchitectureAutoModel
Licenseother

Best Alternatives to Qwen1.5 22B Chat Merge GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Codestral 22B V0.1 GGUF0K / 4.8 GB1409
...t2cypher Codestral Q4 K M Gguf0K / 13.3 GB194
...xt2cypher Codestral 16bit Gguf0K / 44.5 GB280
Nucleus 22B Token 500B GGUF0K / 9.1 GB403
Llama2 22B Daydreamer V3 GGUF0K / 9.1 GB1662
Llama2 22B Daydreamer V2 GGUF0K / 9.1 GB1461
Llama2 22B GPLATTY GGUF0K / 9.1 GB1163
Huginn 22B Prototype GGUF0K / 9.1 GB962
Huginn 22B Prototype GGML0K / 9.2 GB31
Llama2 22B GPLATTY GGML0K / 9.2 GB97
Note: green Score (e.g. "73.2") means that the model is better than DisOOM/Qwen1.5-22B-Chat-Merge-GGUF.

Rank the Qwen1.5 22B Chat Merge GGUF Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer