Tiny Llama 1.8B by DeepMount00

 ยป  All LLMs  ยป  DeepMount00  ยป  Tiny Llama 1.8B   URL Share it on

  Merged Model   Arxiv:1910.09700   Autotrain compatible   Conversational   Endpoints compatible   Mixtral   Region:us   Safetensors

Tiny Llama 1.8B Parameters and Internals

LLM NameTiny Llama 1.8B
Repository ๐Ÿค—https://huggingface.co/DeepMount00/Tiny_llama_1.8b 
Merged ModelYes
Model Size1.8b
Required VRAM3.7 GB
Updated2024-07-04
MaintainerDeepMount00
Model Typemixtral
Model Files  3.7 GB
Model ArchitectureMixtralForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.42.3
Tokenizer ClassLlamaTokenizer
Padding Token<|im_end|>
Vocabulary Size32002
Torch Data Typebfloat16

Best Alternatives to Tiny Llama 1.8B

Best Alternatives
Context / RAM
Downloads
Likes
Mixsmol 4x400M V0.1 Epoch14K / 3.5 GB11112
Mixsmol 4x400M V0.1 Epoch24K / 3.5 GB695
Mixtral 4x400M4K / 7.1 GB1742
Mixsmol 4x400M V0.1 Epoch34K / 3.5 GB125
Note: green Score (e.g. "73.2") means that the model is better than DeepMount00/Tiny_llama_1.8b.

Rank the Tiny Llama 1.8B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 41473 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227