Yi 1.5 6B Chat Ov Int8 by fakezeta

 ยป  All LLMs  ยป  fakezeta  ยป  Yi 1.5 6B Chat Ov Int8   URL Share it on

  Arxiv:2403.04652   Autotrain compatible   Conversational   Endpoints compatible   Llama   Openvino   Region:us

Yi 1.5 6B Chat Ov Int8 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Yi 1.5 6B Chat Ov Int8 Parameters and Internals

LLM NameYi 1.5 6B Chat Ov Int8
Repository ๐Ÿค—https://huggingface.co/fakezeta/Yi-1.5-6B-Chat-ov-int8 
Model Size6b
Required VRAM0 GB
Updated2024-10-18
Maintainerfakezeta
Model Typellama
Model Files  0.0 GB   6.1 GB   0.0 GB
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.40.1
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size64000
Yi 1.5 6B Chat Ov Int8 (fakezeta/Yi-1.5-6B-Chat-ov-int8)

Best Alternatives to Yi 1.5 6B Chat Ov Int8

Best Alternatives
Context / RAM
Downloads
Likes
Yi 6B 200K195K / 12.1 GB5023173
Wukong Yi 6B 200K195K / 12.1 GB101
Yi 6B 200K AEZAKMI V2195K / 12.1 GB10361
Yi 6B 200K DPO195K / 12.1 GB10970
Barcenas 6B 200K195K / 12.1 GB10752
Yi 6B 200K Llamafied195K / 12.1 GB511
Yi 6B 200K Llama195K / 12.1 GB55
Chatglm2 6B Port Llama32K / 12.5 GB04
Miqu 6B Truthy31K / 11.3 GB721
Llama 3 6B V0.18K / 12.6 GB6012
Note: green Score (e.g. "73.2") means that the model is better than fakezeta/Yi-1.5-6B-Chat-ov-int8.

Rank the Yi 1.5 6B Chat Ov Int8 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 36966 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072803