Yi 6B Chat by 01-ai

 ยป  All LLMs  ยป  01-ai  ยป  Yi 6B Chat   URL Share it on

  Arxiv:2311.16502   Arxiv:2401.11944   Arxiv:2403.04652   Autotrain compatible   Conversational   Endpoints compatible   Llama   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF ๐Ÿค—: https://huggingface.co/01-ai/Yi-6B-Chat 

Yi 6B Chat Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Yi 6B Chat (01-ai/Yi-6B-Chat)

Yi 6B Chat Parameters and Internals

Model Type 
Text Generation, Multimodal
Use Cases 
Areas:
Personal, Academic, Commercial
Applications:
Code generation, Math solutions, Commonsense reasoning, Reading comprehension
Limitations:
Hallucination potential, Non-determinism in response generation, Cumulative error in extended tasks
Considerations:
Adjust generation configuration parameters such as temperature, top_p, or top_k to improve output consistency.
Supported Languages 
English (B), Chinese (B)
Training Details 
Data Sources:
3T multilingual corpus
Model Architecture:
Transformer and Llama architectures
Input Output 
Accepted Modalities:
text
Output Format:
text
Performance Tips:
Recommendations to adjust temperature, top_p, or top_k settings for better output.
Release Notes 
Version:
Yi-34B
Date:
2023-11-02
Notes:
Initial open-source release of Yi-34B and Yi-6B base models.
Version:
Yi-9B
Date:
2024-03-06
Notes:
Yi-9B becomes the top performer among similar-sized open-source models in coding, math, and reasoning.
LLM NameYi 6B Chat
Repository ๐Ÿค—https://huggingface.co/01-ai/Yi-6B-Chat 
Model Size6b
Required VRAM12.1 GB
Updated2025-02-05
Maintainer01-ai
Model Typellama
Model Files  4.9 GB: 1-of-3   5.0 GB: 2-of-3   2.2 GB: 3-of-3
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.35.0
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size64000
Torch Data Typebfloat16

Quantized Models of the Yi 6B Chat

Model
Likes
Downloads
VRAM
Yi 6B Chat GGUF0412 GB

Best Alternatives to Yi 6B Chat

Best Alternatives
Context / RAM
Downloads
Likes
Yi 6B 200K195K / 12.1 GB8396172
Yi 6B 200K AEZAKMI V2195K / 12.1 GB12841
Yi 6B 200K DPO195K / 12.1 GB13400
Wukong Yi 6B 200K195K / 12.1 GB141
Barcenas 6B 200K195K / 12.1 GB13232
Yi 6B 200K Llama195K / 12.1 GB85
Yi 6B 200K Llamafied195K / 12.1 GB1411
Llama 3.2 6B AlgoCode128K / 12.7 GB6927
Chatglm2 6B Port Llama32K / 12.5 GB84
Miqu 6B Truthy31K / 11.3 GB1191
Note: green Score (e.g. "73.2") means that the model is better than 01-ai/Yi-6B-Chat.

Rank the Yi 6B Chat Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227