Sabia 7B by maritaca-ai

 ยป  All LLMs  ยป  maritaca-ai  ยป  Sabia 7B   URL Share it on

  Arxiv:2304.07880   Autotrain compatible   Endpoints compatible   Llama   Model-index   Pt   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF ๐Ÿค—: https://huggingface.co/maritaca-ai/sabia-7b 

Sabia 7B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Sabia 7B (maritaca-ai/sabia-7b)

Sabia 7B Parameters and Internals

Model Type 
text generation
Additional Notes 
The model was pretrained on the Portuguese subset of ClueWeb22. The pretraining data has a cutoff of mid-2022.
Supported Languages 
Portuguese (High)
Training Details 
Data Sources:
ClueWeb22
Data Volume:
17 billion tokens
Context Length:
2048
Model Architecture:
Based on LLaMA-1-7B
Input Output 
Input Format:
Text only
Accepted Modalities:
text
Output Format:
Text
Performance Tips:
Optimized for few-shot tasks, recommended to use fp16 or bf16 for best performance.
LLM NameSabia 7B
Repository ๐Ÿค—https://huggingface.co/maritaca-ai/sabia-7b 
Model Size7b
Required VRAM13.5 GB
Updated2025-02-05
Maintainermaritaca-ai
Model Typellama
Model Files  4.9 GB: 1-of-3   5.0 GB: 2-of-3   3.6 GB: 3-of-3
Supported Languagespt
Model ArchitectureLlamaForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.37.2
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typebfloat16

Quantized Models of the Sabia 7B

Model
Likes
Downloads
VRAM
Sabia 7B GGUF51322 GB
Sabia 7B GPTQ2153 GB
Sabia 7B AWQ163 GB

Best Alternatives to Sabia 7B

Best Alternatives
Context / RAM
Downloads
Likes
...1M 1000000ctx AEZAKMI 3 1 17021024K / 13.5 GB531
... Qwen2.5llamaify 7B V23.1 200K195K / 15.2 GB49502
LlamaStock 8B128K / 16.1 GB151
SuperNeuralDreadDevil 8B128K / 16.1 GB311
Yarn Llama 2 7B 128K128K / 13.5 GB570539
LLaMA 7B PoSE YaRN 128K128K / 13.5 GB83
LLaMA 7B PoSE Linear 96K96K / 27 GB82
LLaMA 7B PoSE YaRN 96K96K / 13.5 GB81
Chat Llama2 7B 80K80K / 13.8 GB60
Llama2 7B 80K80K / 13.8 GB90
Note: green Score (e.g. "73.2") means that the model is better than maritaca-ai/sabia-7b.

Rank the Sabia 7B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227