Yi 6B Chat 8bits by 01-ai

 ยป  All LLMs  ยป  01-ai  ยป  Yi 6B Chat 8bits   URL Share it on

  Arxiv:2311.16502   Arxiv:2401.11944   Arxiv:2403.04652   8-bit   Autotrain compatible   Conversational   Endpoints compatible   Gptq   License:apache-2.0   Llama   Region:us   Safetensors

Rank the Yi 6B Chat 8bits Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Yi 6B Chat 8bits (01-ai/Yi-6B-Chat-8bits)

Best Alternatives to Yi 6B Chat 8bits

Best Alternatives
HF Rank
Yi 6B65.24K / 12.1 GB10207363
Yi 1.5 6B Chat IMat GGUF584K / 1.4 GB2870
Yi 1.5 6B Chat GGUF584K / 2.3 GB29753
Yi 1.5 6B Chat GGUF584K / 2.3 GB2451
Yi 6B 200K195K / 12.1 GB7264174
Yi 6B 200K Llamafied195K / 12.1 GB910
Yi 6B 200K Llama195K / 12.1 GB75
Barcenas 6B 200K195K / 12.1 GB12522
Yi 6B 200K AEZAKMI V2195K / 12.1 GB20621
Wukong Yi 6B 200K195K / 12.1 GB31
Note: green Score (e.g. "73.2") means that the model is better than 01-ai/Yi-6B-Chat-8bits.

Yi 6B Chat 8bits Parameters and Internals

LLM NameYi 6B Chat 8bits
RepositoryOpen on ๐Ÿค— 
Model Size6b
Required VRAM6.7 GB
Model Typellama
Model Files  6.7 GB
Model ArchitectureLlamaForCausalLM
Context Length4096
Model Max Length4096
Transformers Version4.35.0
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size64000
Initializer Range0.02
Torch Data Typefloat16

What open-source LLMs or SLMs are you in search of? 34944 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801