QuadConnect2.5 0.5B V0.0.9B by Lyte

 ยป  All LLMs  ยป  Lyte  ยป  QuadConnect2.5 0.5B V0.0.9B   URL Share it on

  Arxiv:2402.03300   4bit   Autotrain compatible   Connect4   Conversational   Dataset:lyte/connectfour-t10   En   Endpoints compatible   Gguf   Grpo   Instruct   Quantized   Qwen   Qwen2   Region:us   Rl   Safetensors   Tensorboard   Trl   Unsloth

QuadConnect2.5 0.5B V0.0.9B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
QuadConnect2.5 0.5B V0.0.9B (Lyte/QuadConnect2.5-0.5B-v0.0.9b)

QuadConnect2.5 0.5B V0.0.9B Parameters and Internals

LLM NameQuadConnect2.5 0.5B V0.0.9B
Repository ๐Ÿค—https://huggingface.co/Lyte/QuadConnect2.5-0.5B-v0.0.9b 
Model NameQuadConnect2.5-0.5B-v0.0.9b
Base Model(s)  unsloth/qwen2.5-0.5b-instruct-unsloth-bnb-4bit   unsloth/qwen2.5-0.5b-instruct-unsloth-bnb-4bit
Model Size0.5b
Required VRAM0.5 GB
Updated2025-03-12
MaintainerLyte
Model Typeqwen2
Instruction-BasedYes
Model Files  1.0 GB   0.0 GB   0.5 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|4bit
Model ArchitectureQwen2ForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.49.0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to QuadConnect2.5 0.5B V0.0.9B

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2.5 Coder 0.5B Merged32K / 1.3 GB850
Qwen2 0.5B Instruct GGUF32K / 0.3 GB187991
Qwen2 0.5B Instruct GGUF32K / 0.3 GB1820
...5 Coder 0.5B Instruct Bnb 4bit32K / 0.5 GB403932
Qwen2.5 0.5B Instruct Bnb 4bit32K / 0.5 GB112853
... Instruct Unsloth Merged 16bit32K / 1.3 GB2931
... Instruct Unsloth Merged 16bit32K / 1.3 GB1572
TinySphinx32K / 1 GB340
... Instruct Unsloth Merged 16bit32K / 1.3 GB671
... Instruct Unsloth Merged 16bit32K / 1.3 GB481
Note: green Score (e.g. "73.2") means that the model is better than Lyte/QuadConnect2.5-0.5B-v0.0.9b.

Rank the QuadConnect2.5 0.5B V0.0.9B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 44902 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227