Gogpt 7B Bloom by golaxy

 ยป  All LLMs  ยป  golaxy  ยป  Gogpt 7B Bloom   URL Share it on

  Autotrain compatible   Bloom Dataset:bellegroup/school math... Dataset:bellegroup/train 0.5m ...   Dataset:bellegroup/train 1m cn   Dataset:bellegroup/train 2m cn Dataset:bellegroup/train 3.5m ...   Endpoints compatible   Pytorch   Region:us   Sharded   Zh
Model Card on HF ๐Ÿค—: https://huggingface.co/golaxy/gogpt-7b-bloom 

Gogpt 7B Bloom Benchmarks

Gogpt 7B Bloom (golaxy/gogpt-7b-bloom)

Gogpt 7B Bloom Parameters and Internals

Model Type 
text generation
Additional Notes 
Training showed significant improvement in the first round while additional rounds showed little enhancement. Plans to include RLFH training and add parallel Chinese-English corpus.
Supported Languages 
zh (full)
Training Details 
Data Sources:
BelleGroup/train_2M_CN, BelleGroup/train_3.5M_CN, BelleGroup/train_1M_CN, BelleGroup/train_0.5M_CN, BelleGroup/school_math_0.25M
Methodology:
Fine-tuning with Chinese instruction data
LLM NameGogpt 7B Bloom
Repository ๐Ÿค—https://huggingface.co/golaxy/gogpt-7b-bloom 
Model Size7b
Required VRAM32.3 GB
Updated2025-02-22
Maintainergolaxy
Model Typebloom
Model Files  9.9 GB: 1-of-4   9.7 GB: 2-of-4   8.6 GB: 3-of-4   4.1 GB: 4-of-4   0.0 GB   0.0 GB
Supported Languageszh
Model ArchitectureBloomForCausalLM
Licenseapache-2.0
Model Max Length2048
Transformers Version4.29.1
Tokenizer ClassBloomTokenizer
Padding Token<pad>
Vocabulary Size250880
Torch Data Typefloat32

Best Alternatives to Gogpt 7B Bloom

Best Alternatives
Context / RAM
Downloads
Likes
...tral 7B Instruct V0.2 Uld Loss0K / 2.2 GB1380
...Qa Llama 2 7B Chat Hf Uld Loss0K / 2.2 GB1370
...lama 2 7B Chat Hf Text Teacher0K / 2.2 GB1370
... 7B Instruct V0.2 Text Teacher0K / 2.2 GB1370
Yayi 7B0K / 28.2 GB194529
Phoenix Inst Chat 7B0K / 16.2 GB194943
Vietcuna 7B 2k50K / 14.2 GB130
Bloom Xp30K / 32.4 GB50
Vietcuna 7B V30K / 14.2 GB1198
Huozi 7B Rlhf0K / 15.6 GB173
Note: green Score (e.g. "73.2") means that the model is better than golaxy/gogpt-7b-bloom.

Rank the Gogpt 7B Bloom Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227