Periquito 3B by wandgibaut

 ยป  All LLMs  ยป  wandgibaut  ยป  Periquito 3B   URL Share it on

  Autotrain compatible   Dataset:wikimedia/wikipedia   Endpoints compatible   Llama   Model-index   Pt   Pytorch   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF ๐Ÿค—: https://huggingface.co/wandgibaut/periquito-3B 

Periquito 3B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Periquito 3B (wandgibaut/periquito-3B)

Periquito 3B Parameters and Internals

Model Type 
Llama, text-generation
Use Cases 
Areas:
text generation, language understanding, various natural language processing tasks
Limitations:
Might exhibit biases present in its training data, Performance primarily optimized for Portuguese, potentially limiting its effectiveness with other languages
Additional Notes 
Specialized in Brazilian Portuguese understanding and generation.
Supported Languages 
Portuguese (high)
Training Details 
Data Sources:
Wikipedia-pt
Methodology:
Finetunning using LoRA in Google's TPU-v3
Hardware Used:
Google's TPU-v3 in Google's TPU Research Program
Model Architecture:
OpenLlama-3B
LLM NamePeriquito 3B
Repository ๐Ÿค—https://huggingface.co/wandgibaut/periquito-3B 
Model Size3b
Required VRAM14.2 GB
Updated2025-03-24
Maintainerwandgibaut
Model Typellama
Model Files  10.0 GB: 1-of-2   4.2 GB: 2-of-2   10.0 GB: 1-of-2   4.2 GB: 2-of-2
Supported Languagespt
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Transformers Version4.31.0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size52000
Torch Data Typefloat32

Best Alternatives to Periquito 3B

Best Alternatives
Context / RAM
Downloads
Likes
Llama 3.2 3B Instruct128K / 6.5 GB26459811268
Hermes 3 Llama 3.2 3B128K / 6.5 GB340437150
Llama 3.2 3B128K / 6.5 GB523672532
DeepSeek R1 Distill Llama 3B128K / 6.5 GB299811
Llama 3.2 3B RP Toxic Fuse128K / 6.4 GB432
Llama 3.2 3B ToxicKod128K / 6.4 GB612
ReasoningCore 3B RE1 V2128K / 6.5 GB1860
Calme 3.1 Llamaloi 3B128K / 10.6 GB30891
...eepHermes 3 Llama 3 3B Preview128K / 6.5 GB332527
Eximius Persona 5B128K / 11.6 GB4335
Note: green Score (e.g. "73.2") means that the model is better than wandgibaut/periquito-3B.

Rank the Periquito 3B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 45494 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227