LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

CroissantLLMBase by croissantllm

 »  All LLMs  »  croissantllm  »  CroissantLLMBase   URL Share it on

  648   
  Arxiv:2402.00786   Art   Autotrain compatible   Code   Dataset:bigcode/starcoderdata Dataset:cerebras/slimpajama-62... Dataset:croissantllm/croissant...   Dataset:pg19   Dataset:uonlp/culturax   En   Endpoints compatible   Fr   Legal   Llama   Pytorch   Region:us   Sharded
Model Card on HF 🤗: https://huggingface.co/croissantllm/CroissantLLMBase 

CroissantLLMBase Benchmarks

ARC: 30.63 vs 96.7 (so35)-68.3%
HellaSwag: 54.18 vs 95.3 (gpt4)-43.1%
MMLU: 25.72 vs 88.3 (so35)-70.9%
TruthfulQA: 37.39 vs 59 (gpt4)-36.6%
WinoGrande: 55.41 vs 87.5 (gpt4)-36.7%
GSM8K: 0.61 vs 96.4 (so35)-99.4%
LLME Score: 0.22457
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
CroissantLLMBase (croissantllm/CroissantLLMBase)

CroissantLLMBase Parameters and Internals

Model Type 
text generation
Additional Notes 
The final model is suited for few-shot prompting strategies and base functions, not finetuned for chat capabilities.
Supported Languages 
en (proficient), fr (proficient)
Training Details 
Data Sources:
cerebras/SlimPajama-627B, uonlp/CulturaX, pg19, bigcode/starcoderdata, croissantllm/croissant_dataset
Data Volume:
3T tokens in English and French
Methodology:
Bilingual training with a custom tokenizer and bilingual finetuning datasets
LLM NameCroissantLLMBase
Repository 🤗https://huggingface.co/croissantllm/CroissantLLMBase 
Model Size627b
Required VRAM5.4 GB
Updated2025-01-15
Maintainercroissantllm
Model Typellama
Model Files  5.0 GB: 1-of-2   0.4 GB: 2-of-2
Supported Languagesfr en
Model ArchitectureLlamaForCausalLM
Licensemit
Context Length2048
Model Max Length2048
Transformers Version4.35.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat32

Best Alternatives to CroissantLLMBase

Best Alternatives
Context / RAM
Downloads
Likes
TinyLlama V1.12K / 4.4 GB5278680
MicroLlama2K / 1.2 GB154642
TinyLlama V1.1 Math Code2K / 4.4 GB150910
TinyLlama 1.1B 1T OpenOrca2K / 2.2 GB2577
...Llama 1.1B 1.5T OpenOrca Alpha2K / 2.2 GB734
TinyLlama V1.1 Chinese2K / 4.4 GB1637
...inyLlama 1.1B 1T OpenOrca GPTQ2K / 0.8 GB172
TinyLlama 1.1B 1T OpenOrca AWQ2K / 0.8 GB162
Note: green Score (e.g. "73.2") means that the model is better than croissantllm/CroissantLLMBase.

Rank the CroissantLLMBase Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 41362 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer