Qwen Jenna V01 Gguf Q4 by V3N0M

 ยป  All LLMs  ยป  V3N0M  ยป  Qwen Jenna V01 Gguf Q4   URL Share it on

  4bit   Conversational   En   Endpoints compatible   Gguf   Q4   Quantized   Qwen2   Region:us   Unsloth

Qwen Jenna V01 Gguf Q4 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Qwen Jenna V01 Gguf Q4 (V3N0M/Qwen-Jenna-v01-gguf-q4)

Qwen Jenna V01 Gguf Q4 Parameters and Internals

Model Type 
text-generation-inference, transformers
Additional Notes 
This model was enhanced for faster training using Unsloth.
Supported Languages 
en (high)
Training Details 
Methodology:
Trained 2x faster with Unsloth and Huggingface's TRL library
LLM NameQwen Jenna V01 Gguf Q4
Repository ๐Ÿค—https://huggingface.co/V3N0M/Qwen-Jenna-v01-gguf-q4 
Base Model(s)  unsloth/qwen2-0.5b-bnb-4bit   unsloth/qwen2-0.5b-bnb-4bit
Model Size0.5b
Required VRAM0.4 GB
Updated2025-02-04
MaintainerV3N0M
Model Typeqwen2
Model Files  0.4 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|q4|4bit
Model ArchitectureAutoModel
Licenseapache-2.0

Best Alternatives to Qwen Jenna V01 Gguf Q4

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2 0.5B Fncl GGUF0K / 1 GB180
...0.5B Instruct Bnb 4bit Q4KM 1E0K / 0.4 GB270
Qwen2 0.5B GGUF0K / 0.4 GB50
Qwen2 0.5B Instruct Sorah GGUF0K / 0.4 GB340
Qwen2 0.5B Gguf F160K / 1 GB190
Qwen2 0.5B F160K / 1 GB160
Qwen2 0.5B Gguf Q4 K M0K / 0.4 GB100
Qwen2 0.5B Q5 K M0K / 0.4 GB100
Qwen2 0.5B Q4 K M0K / 0.4 GB80
Qwen2 0.5B Q8 00K / 0.5 GB60
Note: green Score (e.g. "73.2") means that the model is better than V3N0M/Qwen-Jenna-v01-gguf-q4.

Rank the Qwen Jenna V01 Gguf Q4 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227