Periquito 3B by wandgibaut

 ยป  All LLMs  ยป  wandgibaut  ยป  Periquito 3B   URL Share it on

  Autotrain compatible   Dataset:wikimedia/wikipedia   Endpoints compatible   Llama   Model-index   Pt   Pytorch   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF ๐Ÿค—: https://huggingface.co/wandgibaut/periquito-3B 

Periquito 3B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Periquito 3B (wandgibaut/periquito-3B)

Periquito 3B Parameters and Internals

Model Type 
Llama, text-generation
Use Cases 
Areas:
text generation, language understanding, various natural language processing tasks
Limitations:
Might exhibit biases present in its training data, Performance primarily optimized for Portuguese, potentially limiting its effectiveness with other languages
Additional Notes 
Specialized in Brazilian Portuguese understanding and generation.
Supported Languages 
Portuguese (high)
Training Details 
Data Sources:
Wikipedia-pt
Methodology:
Finetunning using LoRA in Google's TPU-v3
Hardware Used:
Google's TPU-v3 in Google's TPU Research Program
Model Architecture:
OpenLlama-3B
LLM NamePeriquito 3B
Repository ๐Ÿค—https://huggingface.co/wandgibaut/periquito-3B 
Model Size3b
Required VRAM14.2 GB
Updated2025-06-01
Maintainerwandgibaut
Model Typellama
Model Files  10.0 GB: 1-of-2   4.2 GB: 2-of-2   10.0 GB: 1-of-2   4.2 GB: 2-of-2
Supported Languagespt
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Transformers Version4.31.0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size52000
Torch Data Typefloat32

Best Alternatives to Periquito 3B

Best Alternatives
Context / RAM
Downloads
Likes
ISA 03 Mini 3B Hybrid Preview256K / 6.5 GB3073
Llama 3.2 3B Instruct128K / 6.5 GB16825741489
Llama 3.2 3B128K / 6.5 GB390042568
Hermes 3 Llama 3.2 3B128K / 6.5 GB39588159
Cogito V1 Preview Llama 3B128K / 7.2 GB274695
DeepSeek R1 Distill Llama 3B128K / 6.5 GB46811
Calme 3.1 Llamaloi 3B128K / 10.6 GB34021
Orpheus 3B 0.1 Ft128K / 6.6 GB147433
Orpheus 3B 0.1 Pretrained128K / 6.6 GB109640
Llama 3.2 3B RP Toxic Fuse128K / 6.4 GB112
Note: green Score (e.g. "73.2") means that the model is better than wandgibaut/periquito-3B.

Rank the Periquito 3B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 47770 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227