XVERSE 7B by xverse

 ยป  All LLMs  ยป  xverse  ยป  XVERSE 7B   URL Share it on

  Arxiv:2009.03300   Arxiv:2304.06364   Autotrain compatible   Custom code   Pytorch   Region:us   Sharded   Xverse
Model Card on HF ๐Ÿค—: https://huggingface.co/xverse/XVERSE-7B 

XVERSE 7B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
XVERSE 7B (xverse/XVERSE-7B)

XVERSE 7B Parameters and Internals

Model Type 
Multilingual, Large Language Model, Decoder-only Transformer
Use Cases 
Areas:
Research, Commercial Applications
Limitations:
Under certain circumstances may produce inaccurate, biased, or otherwise offensive content.
Considerations:
Conduct safety tests and optimization before deploying the model in specific applications.
Supported Languages 
Chinese (Excellent), English (Excellent), Russian (Satisfactory), Spanish (Satisfactory), Other Languages (Satisfactory)
Training Details 
Data Sources:
Diversified dataset of over 40 languages including Chinese, English, Russian, and Spanish.
Data Volume:
2.6 trillion tokens
Context Length:
8000
Model Architecture:
Decoder-only Transformer
Input Output 
Input Format:
Tokenized text input using BPE algorithm.
Accepted Modalities:
Text
Output Format:
Text
Performance Tips:
Ensure efficient memory management and parallel scheduling for optimal performance.
LLM NameXVERSE 7B
Repository ๐Ÿค—https://huggingface.co/xverse/XVERSE-7B 
Model Size7b
Required VRAM14.8 GB
Updated2025-02-22
Maintainerxverse
Model Typexverse
Model Files  1.9 GB: 1-of-8   2.0 GB: 2-of-8   2.0 GB: 3-of-8   2.0 GB: 4-of-8   2.0 GB: 5-of-8   2.1 GB: 6-of-8   2.0 GB: 7-of-8   0.8 GB: 8-of-8
Model ArchitectureXverseForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.30.0.dev0
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size100534
Torch Data Typebfloat16

Best Alternatives to XVERSE 7B

Best Alternatives
Context / RAM
Downloads
Likes
Xverse XVERSE 7B Ov8K / 7.3 GB50
XVERSE 7B Chat8K / 14.8 GB2288
Tiny Random Xverse0.1K / 0 GB1277440
Note: green Score (e.g. "73.2") means that the model is better than xverse/XVERSE-7B.

Rank the XVERSE 7B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227