Yi 6B Chat 8bits by 01-ai

 ยป  All LLMs  ยป  01-ai  ยป  Yi 6B Chat 8bits   URL Share it on

  Arxiv:2311.16502   Arxiv:2401.11944   Arxiv:2403.04652   8-bit   Autotrain compatible   Conversational   Endpoints compatible   Gptq   License:apache-2.0   Llama   Region:us   Safetensors

Rank the Yi 6B Chat 8bits Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Yi 6B Chat 8bits (01-ai/Yi-6B-Chat-8bits)

Best Alternatives to Yi 6B Chat 8bits

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
Yi 6B65.24K / 12.1 GB10207363
Yi 1.5 6B Chat IMat GGUF584K / 1.4 GB2870
Yi 1.5 6B Chat GGUF584K / 2.3 GB29753
Yi 1.5 6B Chat GGUF584K / 2.3 GB2451
Yi 6B 200K195K / 12.1 GB7264174
Yi 6B 200K Llamafied195K / 12.1 GB910
Yi 6B 200K Llama195K / 12.1 GB75
Barcenas 6B 200K195K / 12.1 GB12522
Yi 6B 200K AEZAKMI V2195K / 12.1 GB20621
Wukong Yi 6B 200K195K / 12.1 GB31
Note: green Score (e.g. "73.2") means that the model is better than 01-ai/Yi-6B-Chat-8bits.

Yi 6B Chat 8bits Parameters and Internals

LLM NameYi 6B Chat 8bits
RepositoryOpen on ๐Ÿค— 
Model Size6b
Required VRAM6.7 GB
Updated2024-06-23
Maintainer01-ai
Model Typellama
Model Files  6.7 GB
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.35.0
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size64000
Initializer Range0.02
Torch Data Typefloat16

What open-source LLMs or SLMs are you in search of? 34944 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801