QwQ LCoT 3B Instruct GGUF by prithivMLmods

 ยป  All LLMs  ยป  prithivMLmods  ยป  QwQ LCoT 3B Instruct GGUF   URL Share it on

  3b   8-bit Base model:prithivmlmods/qwq-l... Base model:quantized:prithivml...   Conversational Dataset:amphora/qwq-longcot-13...   En   Endpoints compatible   F16   Fp16   Gguf   Instruct   Long-cot   Quantized   Qwen2   Qwq   Region:us

QwQ LCoT 3B Instruct GGUF Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
QwQ LCoT 3B Instruct GGUF (prithivMLmods/QwQ-LCoT-3B-Instruct-GGUF)

QwQ LCoT 3B Instruct GGUF Parameters and Internals

LLM NameQwQ LCoT 3B Instruct GGUF
Repository ๐Ÿค—https://huggingface.co/prithivMLmods/QwQ-LCoT-3B-Instruct-GGUF 
Base Model(s)  QwQ LCoT 3B Instruct   prithivMLmods/QwQ-LCoT-3B-Instruct
Model Size3b
Required VRAM1.9 GB
Updated2025-02-15
MaintainerprithivMLmods
Model Typeqwen2
Instruction-BasedYes
Model Files  6.2 GB   1.9 GB   2.2 GB   3.3 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typefp16|gguf
Model ArchitectureAutoModel
Licensecreativeml-openrail-m

Best Alternatives to QwQ LCoT 3B Instruct GGUF

Best Alternatives
Context / RAM
Downloads
Likes
MedQwen3B Reasoner0K / 6.2 GB7018
Llama 3.2 3B VanRossum0K / 6.5 GB2820
...a Song Stream 3B Instruct GGUF0K / 2 GB31211
...ma Magpie 3.2 3B Instruct GGUF0K / 2 GB3398
...ma Doctor 3.2 3B Instruct GGUF0K / 2 GB38711
... Sentient 3.2 3B Instruct GGUF0K / 2 GB23311
Llama 3.2 3B Instruct GGUF0K / 2 GB2428
Granite 3B Code Instruct GGUF0K / 1.3 GB106001
Phi 3 Phituguese 3B Gguf 16bit0K / 7.6 GB331
Phi 3 Phituguese 3B Q4 K M0K / 2.3 GB361
Note: green Score (e.g. "73.2") means that the model is better than prithivMLmods/QwQ-LCoT-3B-Instruct-GGUF.

Rank the QwQ LCoT 3B Instruct GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43137 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227