EVA Yi 1.5 9B 32K V1 by EVA-UNIT-01

 ยป  All LLMs  ยป  EVA-UNIT-01  ยป  EVA Yi 1.5 9B 32K V1   URL Share it on

Base model:auriaetherwiing/yi-... Base model:finetune:auriaether... Dataset:allura-org/celeste-1.x... Dataset:kalomaze/opus instruct...   Instruct   Llama   Region:us   Safetensors   Sharded   Tensorflow

EVA Yi 1.5 9B 32K V1 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

EVA Yi 1.5 9B 32K V1 Parameters and Internals

Model Type 
RP, storywriting
Additional Notes 
Continuation of nothingiisreal's Celeste 1.x series designed to improve stability and versatility, while maintaining unique writing style.
Training Details 
Data Sources:
Celeste 70B 0.1 data mixture minus Opus Instruct subset, Kalomaze's Opus_Instruct_25k dataset, filtered for refusals
Methodology:
full-parameter finetune
Hardware Used:
4x3090Ti for 5 days
Input Output 
Input Format:
ChatML
Performance Tips:
Recommend using original BFloat16 weights; quantization affects Yi significantly more than other model architectures.
LLM NameEVA Yi 1.5 9B 32K V1
Repository ๐Ÿค—https://huggingface.co/EVA-UNIT-01/EVA-Yi-1.5-9B-32K-V1 
Base Model(s)  AuriAetherwiing/Yi-1.5-9B-32K-tokfix   AuriAetherwiing/Yi-1.5-9B-32K-tokfix
Model Size9b
Required VRAM17.7 GB
Updated2024-11-21
MaintainerEVA-UNIT-01
Model Typellama
Instruction-BasedYes
Model Files  4.9 GB: 1-of-4   5.0 GB: 2-of-4   5.0 GB: 3-of-4   2.8 GB: 4-of-4   0.0 GB
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.45.0.dev0
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<unk>
Vocabulary Size64000
Torch Data Typebfloat16
EVA Yi 1.5 9B 32K V1 (EVA-UNIT-01/EVA-Yi-1.5-9B-32K-V1)

Best Alternatives to EVA Yi 1.5 9B 32K V1

Best Alternatives
Context / RAM
Downloads
Likes
Yi Coder 9B Chat Instruct TIES128K / 17.7 GB170
...ity Instruct 3M 0625 Yi 1.5 9B4K / 17.7 GB66583
ChinaLM 9B4K / 17.9 GB131
Llama 3 Experiment V1 9B GGUF8K / 5.4 GB360
Note: green Score (e.g. "73.2") means that the model is better than EVA-UNIT-01/EVA-Yi-1.5-9B-32K-V1.

Rank the EVA Yi 1.5 9B 32K V1 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 38199 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241110