BioMistral 7B DARE GGUF by BioMistral

 ยป  All LLMs  ยป  BioMistral  ยป  BioMistral 7B DARE GGUF   URL Share it on

  Arxiv:2306.01708   Arxiv:2311.03099   Arxiv:2402.10373   Autotrain compatible Base model:biomistral/biomistr... Base model:merge:biomistral/bi... Base model:merge:mistralai/mis... Base model:mistralai/mistral-7...   Biology   Conversational   Dare   Dataset:pubmed   De   En   Endpoints compatible   Es   Fr   Ggml   Gguf   Instruct   It   Medical   Merge   Mergekit   Mistral   Nl   Pl   Q2   Quantized   Region:us   Ro

BioMistral 7B DARE GGUF Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
BioMistral 7B DARE GGUF (BioMistral/BioMistral-7B-DARE-GGUF)

BioMistral 7B DARE GGUF Parameters and Internals

Model Type 
text-generation
Use Cases 
Areas:
research
Applications:
biomedical research, text generation
Primary Use Cases:
medical question-answering, multilingual evaluation
Limitations:
Not suitable for professional medical advice, Potential biases and ethical issues
Considerations:
Users need to be aware of biases and test extensively before use in critical scenarios.
Additional Notes 
The model and its evaluation benchmarks are freely available for research purposes.
Supported Languages 
en (English), fr (French), nl (Dutch), es (Spanish), it (Italian), pl (Polish), ro (Romanian), de (German)
Training Details 
Data Sources:
PubMed Central
Methodology:
DARE (using TIES merge method) on base model Mistral-7B-Instruct-v0.1
Context Length:
2048
Hardware Used:
CNRS Jean Zay French HPC
Model Architecture:
Mistral-based architecture
Responsible Ai Considerations 
Fairness:
Under evaluation
Transparency:
Requires user caution due to potential biases
Accountability:
Developers emphasize research use over production use
Mitigation Strategies:
Advised testing in random controlled trials for medical applications
Input Output 
Input Format:
Text
Accepted Modalities:
text
Output Format:
Text
LLM NameBioMistral 7B DARE GGUF
Repository ๐Ÿค—https://huggingface.co/BioMistral/BioMistral-7B-DARE-GGUF 
Base Model(s)  BioMistral 7B   mistralai/Mistral-7B-Instruct-v0.1   BioMistral/BioMistral-7B   mistralai/Mistral-7B-Instruct-v0.1
Model Size7b
Required VRAM2.7 GB
Updated2025-02-22
MaintainerBioMistral
Model Typemistral
Instruction-BasedYes
Model Files  2.7 GB   2.9 GB   3.5 GB   3.2 GB   4.1 GB   4.4 GB   4.1 GB   5.1 GB   5.0 GB   5.9 GB   7.7 GB
Supported Languagesen fr nl es it pl ro de
GGML QuantizationYes
GGUF QuantizationYes
Quantization Typegguf|ggml|q2|q4_k|q5_k
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.36.2
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to BioMistral 7B DARE GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Mistral 7B V0.2 Csn SFT32K / 14.4 GB150
Instruct 16bit32K / 0.4 GB50
Filiberto 7B Instruct Exp132K / 14.5 GB310
MistralMusic32K / 14.4 GB261
...ns Extraction Lora Merged GGUF32K / 5.1 GB100
Synatra 7B V0.3 RP GGUF32K / 4.4 GB208
Mistral Turkish Gguf32K / 5.1 GB141
Rag Tge Pl Bielik4K / 14.4 GB170
Mistral 7B Instruct V0.2.gguf32K / 14.5 GB63
Mistral 7B Instruct V0.2 GGUF32K / 4.4 GB172
Note: green Score (e.g. "73.2") means that the model is better than BioMistral/BioMistral-7B-DARE-GGUF.

Rank the BioMistral 7B DARE GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227