Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 by NickyNicky

 ยป  All LLMs  ยป  NickyNicky  ยป  Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1   URL Share it on

  Ar   Autotrain compatible   Bn   Ca   Cs   Da   De   En   Endpoints compatible   Eo   Es   Eu   Fi   Fr   He   Hu   Id   It   Ja   Ko   Merge   Mixtral   Moe   Nl   Pl   Region:us   Ru   Safetensors   Sharded   Sv   Tensorflow   Th   Tr   Vi   Zh

Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 Parameters and Internals

LLM NameMix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1
Repository ๐Ÿค—https://huggingface.co/NickyNicky/Mix_TinyLlama-3x1B_oasst2_chatML_Cluster_3_2_1_V1 
Model Size2.6b
Required VRAM5.2 GB
Updated2024-09-07
MaintainerNickyNicky
Model Typemixtral
Model Files  5.0 GB: 1-of-2   0.2 GB: 2-of-2
Supported Languagesen es ru zh de fr th ca it ja pl eo eu vi fi hu ar nl da tr ko he id cs bn sv
Model ArchitectureMixtralForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.37.1
Tokenizer ClassLlamaTokenizer
Padding Token<s>
Vocabulary Size32002
Torch Data Typebfloat16
Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 (NickyNicky/Mix_TinyLlama-3x1B_oasst2_chatML_Cluster_3_2_1_V1)

Best Alternatives to Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1

Best Alternatives
Context / RAM
Downloads
Likes
TinyExperts V0 4x1B32K / 5.2 GB6780
TinyEnsemble 3x1.1B TinyMoE4K / 5.3 GB110
...x MoE Samantha Chatml Therabot4K / 5.2 GB101
LiteLlamix 8x460M 1T1K / 5.2 GB213
Note: green Score (e.g. "73.2") means that the model is better than NickyNicky/Mix_TinyLlama-3x1B_oasst2_chatML_Cluster_3_2_1_V1.

Rank the Mix TinyLlama 3x1B Oasst2 ChatML Cluster 3 2 1 V1 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 35693 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072803