Claire 7B 0.1 AWQ by TheBloke

 »  All LLMs  »  TheBloke  »  Claire 7B 0.1 AWQ   URL Share it on

  4-bit   Autotrain compatible   Awq Base model:openllm-france/clai... Base model:quantized:openllm-f...   Conversational   Custom code   Endpoints compatible   Falcon   Fr   Pretrained   Quantized   Region:us   Safetensors

Claire 7B 0.1 AWQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Claire 7B 0.1 AWQ (TheBloke/Claire-7B-0.1-AWQ)

Claire 7B 0.1 AWQ Parameters and Internals

Model Type 
causal decoder
Additional Notes 
The model is attuned to French conversational dialogues, potentially generating dialogues with spoken disfluencies.
Supported Languages 
fr (native)
Training Details 
Data Sources:
assemblée-nationale.fr, theatre-classique.fr, theatregratuit.com, TCOF, CFPP, CFPB, ACSYNT, PFC, Valibel (ORFEO), ESLO, CRFP, OFROM, CID, Rhapsodie, ParisStories, CLAPI, C-ORAL-ROM (ORFEO), LinTO, SUMM-RE, Réunions de travail (ORFEO), FreD, Fleuron (ORFEO), Accueil UBS, OTG
Data Volume:
Cumulative 161.9 million words
Methodology:
Tuning from Falcon-7b using French conversational data
Context Length:
2048
Training Time:
50 GPU hours on 1 A100 80GB GPU
Hardware Used:
1 A100 80GB GPU
Model Architecture:
Causal decoder-only
Input Output 
Input Format:
Prompt template: '- Bonjour BotName, {prompt} - Bonjour UserName, '
Accepted Modalities:
text
Output Format:
Text dialogues
LLM NameClaire 7B 0.1 AWQ
Repository 🤗https://huggingface.co/TheBloke/Claire-7B-0.1-AWQ 
Model NameClaire 7B 0.1
Model CreatorOpenLLM France
Base Model(s)  OpenLLM-France/Claire-7B-0.1   OpenLLM-France/Claire-7B-0.1
Model Size7b
Required VRAM4.8 GB
Updated2025-05-14
MaintainerTheBloke
Model Typefalcon
Model Files  4.8 GB
Supported Languagesfr
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureFalconForCausalLM
Licensecc-by-nc-sa-4.0
Context Length2048
Model Max Length2048
Transformers Version4.35.0
Is Biased0
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size65024
Torch Data Typebfloat16

Best Alternatives to Claire 7B 0.1 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Falcon 7B Instruct Bnb 8bit2K / 7.2 GB121
Falcon 7B Instruct Bnb 4bit2K / 4 GB81
...n 7B Instruct Bnb 8bit Smashed0K / 7.2 GB90
F1H10M 00002K / 13.9 GB25290
Really Tiny Falcon Testing2K / 0 GB1649300
Saqr 7B Merged2K / 13.9 GB91
... Openassistant Toxicity Reduce2K / 30.4 GB60
F1H10M 00002K / 13.9 GB100
Falcon Chatbot2K / 5.5 GB101
DociproLLM 7B2K / 27.8 GB60
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/Claire-7B-0.1-AWQ.

Rank the Claire 7B 0.1 AWQ Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 47340 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227