Chinese Llama 2 13B by ziqingyang

 ยป  All LLMs  ยป  ziqingyang  ยป  Chinese Llama 2 13B   URL Share it on

  Autotrain compatible   En   Endpoints compatible   Llama   Pytorch   Region:us   Sharded   Zh
Model Card on HF ๐Ÿค—: https://huggingface.co/hfl/chinese-llama-2-13b 

Chinese Llama 2 13B Benchmarks

Chinese Llama 2 13B (hfl/chinese-llama-2-13b)

Chinese Llama 2 13B Parameters and Internals

Model Type 
full-parameter model, instruction-following model
Additional Notes 
Chinese-LLaMA-2-7B is part of the second generation of the Chinese LLaMA & Alpaca LLM project, and it's based on Llama-2 by Meta. It supports a 4K context and can be expanded up to 18K+ using the NTK method. It uses a new extended Chinese vocabulary beyond Llama-2 and has been improved by large-scale Chinese data for better semantic understanding.
Supported Languages 
zh (High), en (High)
LLM NameChinese Llama 2 13B
Repository ๐Ÿค—https://huggingface.co/hfl/chinese-llama-2-13b 
Model Size13b
Required VRAM26.5 GB
Updated2025-02-05
Maintainerziqingyang
Model Typellama
Model Files  10.2 GB: 1-of-3   9.9 GB: 2-of-3   6.4 GB: 3-of-3
Supported Languageszh en
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.32.0.dev0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size55296
Torch Data Typefloat16

Quantized Models of the Chinese Llama 2 13B

Model
Likes
Downloads
VRAM
Chinese Llama 2 13B Gguf54445 GB

Best Alternatives to Chinese Llama 2 13B

Best Alternatives
Context / RAM
Downloads
Likes
Yarn Llama 2 13B 128K128K / 26 GB4778113
Luminaura RP 13B128K / 26 GB90
Agent Llama2 13B 80K80K / 26.4 GB140
Chat Llama2 13B 80K80K / 52.8 GB110
LongAlign 13B 64K64K / 26 GB1713
LongAlign 13B 64K Base64K / 26 GB143
Yarn Llama 2 13B 64K64K / 26 GB489917
Openbuddy Llama2 13B V15p1 64K64K / 26.1 GB64
Openbuddy Llama2 13b64k V1564K / 26.1 GB131
Airoboros L2 13B 2.1 YaRN 64K64K / 26 GB117
Note: green Score (e.g. "73.2") means that the model is better than hfl/chinese-llama-2-13b.

Rank the Chinese Llama 2 13B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42625 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227