FlorRAG by projecte-aina

 ยป  All LLMs  ยป  projecte-aina  ยป  FlorRAG   URL Share it on

  Autotrain compatible   Bloom   Ca   En   Endpoints compatible   Es   License:apache-2.0   Rag   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF ๐Ÿค—: https://huggingface.co/projecte-aina/FlorRAG 
FlorRAG (projecte-aina/FlorRAG)

FlorRAG Parameters and Internals

Model Type 
text-generation
Use Cases 
Areas:
RAG applications
Primary Use Cases:
Text generation in the context of retrieval-augmented generation
Limitations:
Possible bias and toxicity as the model is trained on data collected via web crawling methods.
Considerations:
Users should be aware of biases and compliance with regulations.
Additional Notes 
No measures have been taken to estimate the bias and toxicity embedded in the model.
Supported Languages 
ca (Catalan), es (Spanish), en (English)
Training Details 
Data Sources:
projecte-aina/RAG_Multilingual
Data Volume:
56,406 RAG instruction examples
Methodology:
Trained on a customized QA dataset from various sources with a Mixture of Expert model to follow RAG-style instructions.
Model Architecture:
Transformer-based causal language model
Responsible Ai Considerations 
Mitigation Strategies:
Users are responsible for mitigating the risks when using the model.
Input Output 
Input Format:
Text prompts
Accepted Modalities:
text
Output Format:
Generated text
LLM NameFlorRAG
Repository ๐Ÿค—https://huggingface.co/projecte-aina/FlorRAG 
Model Size6.3b
Required VRAM12.4 GB
Updated2024-07-04
Maintainerprojecte-aina
Model Typebloom
Model Files  9.9 GB: 1-of-2   2.5 GB: 2-of-2
Supported Languagesca es en
Model ArchitectureBloomForCausalLM
Licenseapache-2.0
Transformers Version4.28.1
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size50257
Torch Data Typefloat16
Errorsreplace

Best Alternatives to FlorRAG

Best Alternatives
Context / RAM
Downloads
Likes
OpenHermes 2.5 FLOR 6.3B0K / 13 GB651
FLOR RAG EADOP0K / 12.4 GB300
FLOR 6.3B Xat0K / 12.5 GB170
FLOR 6.3B Instructed0K / 12.4 GB00
FLOR 6.3B0K / 12.5 GB00
Note: green Score (e.g. "73.2") means that the model is better than projecte-aina/FlorRAG.

Rank the FlorRAG Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 41363 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227