CabraQwen7b by botbot-ai

 »  All LLMs  »  botbot-ai  »  CabraQwen7b   URL Share it on

  Autotrain compatible Base model:finetune:qwen/qwen1... Base model:qwen/qwen1.5-7b-cha...   Brasil   Brazil   Conversational   En   Endpoints compatible   Gguf   Model-index   Portuguese   Pt   Qwen   Qwen2   Region:us   Safetensors   Sharded   Tensorflow

CabraQwen7b Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
CabraQwen7b (botbot-ai/CabraQwen7b)

CabraQwen7b Parameters and Internals

Model Type 
text-generation
Use Cases 
Areas:
Pesquisa
Applications:
Modelos gerativos
Primary Use Cases:
Pesquisa sobre modelos gerativos, Investigação e compreensão das limitações e viéses de modelos gerativos
Additional Notes 
Esse modelo é um finetune do [Qwen 1.5 7b Chat](https://huggingface.co/Qwen/Qwen1.5-7B-Chat) com o dataset interno Cabra 10k. Esse modelo é optimizado para português e responde em portuguese nativamente. Ele apresenta melhoria em varios benchmarks brasileiros em comparação com o modelo base.
Supported Languages 
pt (native)
Training Details 
Data Sources:
Cabra 10k
Model Architecture:
Transformer with SwiGLU activation, QKV attention bias, grouped query attention, mixture of sliding window attention and full attention.
LLM NameCabraQwen7b
Repository 🤗https://huggingface.co/botbot-ai/CabraQwen7b 
Base Model(s)  Qwen/Qwen1.5-7B-Chat   Qwen/Qwen1.5-7B-Chat
Model Size7b
Required VRAM15.4 GB
Updated2025-03-23
Maintainerbotbot-ai
Model Typeqwen2
Model Files  5.0 GB: 1-of-4   5.0 GB: 2-of-4   4.2 GB: 3-of-4   1.2 GB: 4-of-4
Supported Languagespt en
Model ArchitectureQwen2ForCausalLM
Licensecc
Context Length32768
Model Max Length32768
Transformers Version4.39.0.dev0
Tokenizer ClassQwen2Tokenizer
Padding Token<|im_end|>
Vocabulary Size151646
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to CabraQwen7b

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2.5 7B Instruct 1M986K / 15.4 GB124329274
Hush Qwen2.5 7B Preview986K / 15.2 GB860
Hush Qwen2.5 7B RP V1.4 1M986K / 15.2 GB422
Hush Qwen2.5 7B V1.1986K / 15.2 GB291
Hush Qwen2.5 7B V1.2986K / 15.2 GB221
Hush Qwen2.5 7B V1.4986K / 15.2 GB241
Hush Qwen2.5 7B V1.3986K / 15.2 GB272
Qwen2.5 7B RRP 1M986K / 15.2 GB1416
Qwen2.5 7B MixStock V0.1986K / 15.2 GB1083
Qwen2.5 7B Preview986K / 15.2 GB220
Note: green Score (e.g. "73.2") means that the model is better than botbot-ai/CabraQwen7b.

Rank the CabraQwen7b Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 45433 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227