LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

FLOR 1.3B by projecte-aina

 »  All LLMs  »  projecte-aina  »  FLOR 1.3B   URL Share it on

  0   
  Autotrain compatible   Bloom   Ca   Catalan   En   Endpoints compatible   English   Es   Flor   License:apache-2.0   Region:us   Safetensors   Spanish
Model Card on HF 🤗: https://huggingface.co/projecte-aina/FLOR-1.3B 
FLOR 1.3B (projecte-aina/FLOR-1.3B)

FLOR 1.3B Parameters and Internals

Model Type 
transformer-based, causal language model
Use Cases 
Areas:
General purpose
Applications:
Text generation, Language modeling, Fine-tuning for specific tasks
Primary Use Cases:
Causal language modeling
Limitations:
Possible biases from training data
Additional Notes 
This model is part of the Aina project, funded by the Government of Catalonia. It is designed to handle high proficiency in Catalan and Spanish, with medium proficiency in English.
Supported Languages 
Catalan (High), Spanish (High), English (Medium)
Training Details 
Data Sources:
Wikipedia, C4_es, Biomedical, Legal, Gutenberg, CaWaC, Vilaweb
Data Volume:
26B tokens
Methodology:
Language adaptation technique with BPE tokenizer and embedding adjustments
Hardware Used:
CS-2 system
Model Architecture:
Transformer-based architecture adapted from BLOOM-1.7B
Input Output 
Input Format:
Text prompt
Accepted Modalities:
text
Output Format:
Generated text
Performance Tips:
Ensure the input is well-formed and contextually appropriate for improved generation.
LLM NameFLOR 1.3B
Repository 🤗https://huggingface.co/projecte-aina/FLOR-1.3B 
Model Size1.3b
Required VRAM2.6 GB
Updated2024-07-04
Maintainerprojecte-aina
Model Typebloom
Model Files  2.6 GB
Supported Languagesen es ca
Model ArchitectureBloomForCausalLM
Licenseapache-2.0
Transformers Version4.31.0
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size50257
Torch Data Typefloat32
Errorsreplace

Best Alternatives to FLOR 1.3B

Best Alternatives
Context / RAM
Downloads
Likes
Carballo Finetuned0K / 5.3 GB4340
FLOR 1.3B Xat0K / 2.6 GB740
RAGFlor1.30K / 2.6 GB920
RAGGFlor1.30K / 2.6 GB80
Flor1.3RAG0K / 2.6 GB861
FLOR 1.3B Instructed0K / 2.6 GB910
CaBloom1.3 MultiQA0K / 2.6 GB130
CaBloom1.3 QA0K / 2.6 GB100
Bloom1.3 Meteo0K / 2.6 GB70
Hoa 1b40K / 5.2 GB4291
Note: green Score (e.g. "73.2") means that the model is better than projecte-aina/FLOR-1.3B.

Rank the FLOR 1.3B Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer