Baichuan 7B by baichuan-inc

 ยป  All LLMs  ยป  baichuan-inc  ยป  Baichuan 7B   URL Share it on

  Arxiv:1910.07467   Arxiv:2009.03300   Autotrain compatible   Baichuan   Custom code   En   Endpoints compatible   Pytorch   Region:us   Zh

Baichuan 7B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Baichuan 7B (baichuan-inc/Baichuan-7B)

Baichuan 7B Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
Research, Commercial applications
Applications:
NLP tasks, Text generation
Limitations:
Factually incorrect outputs possible; should not be relied on for accurate information.
Supported Languages 
Chinese (SOTA), English (Supported)
Training Details 
Data Sources:
Proprietary bilingual Chinese-English corpora
Data Volume:
1.2 trillion tokens
Methodology:
Based on the Transformer architecture, optimized for Chinese.
Context Length:
4096
Model Architecture:
Standard Transformer structure with rotary-embedding, SwiGLU feedforward layer, and RMSNorm Layer Normalization.
LLM NameBaichuan 7B
Repository ๐Ÿค—https://huggingface.co/baichuan-inc/Baichuan-7B 
Model Size7b
Required VRAM14 GB
Updated2024-12-26
Maintainerbaichuan-inc
Model Typebaichuan
Model Files  14.0 GB
Supported Languageszh en
Model ArchitectureBaiChuanForCausalLM
Context Length4096
Model Max Length4096
Transformers Version4.29.1
Tokenizer ClassBaiChuanTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size64000
Torch Data Typefloat32

Best Alternatives to Baichuan 7B

Best Alternatives
Context / RAM
Downloads
Likes
WisdomInterrogatory4K / 13.9 GB144
MedChatZH4K / 14 GB796
HuatuoGPT 7B4K / 28 GB46622
Qiaoban Bc4K / 28 GB137
Baichuan 7B Instruction4K / 14 GB172
Baichuan 7B Sft 0014K / 14 GB143
Baichuan 7B Sft4K / 14 GB2176
Baichuan 7B4K / 13.8 GB160
Baichuan 7B Chat4K / 14 GB3425
Baichuan 7B Sharded4K / 13.9 GB181

Rank the Baichuan 7B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40248 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217