LLM Explorer: A Curated Large Language Model Directory and Analytics  // 

Tinyllama Bnb 4bit by unsloth

What open-source LLMs or SLMs are you in search of? 18857 in total.

 ยป  All LLMs  ยป  unsloth  ยป  Tinyllama Bnb 4bit   URL Share it on

  4-bit   4bit   Autotrain compatible   Endpoints compatible   License:apache-2.0   Llama   Quantized   Region:us   Safetensors

Rank the Tinyllama Bnb 4bit Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Tinyllama Bnb 4bit (unsloth/tinyllama-bnb-4bit)

Quantized Models of the Tinyllama Bnb 4bit

Hi Tinylama172 GB
Hi Tinylama Gguf 16bit112 GB
...inyllama Ft CodeAlpaca Adapter100 GB
Tiny0462 GB
Test Model 16bit 250282 GB
...llama 3T 128K JsonExtract V1.00212 GB
...inyllama Function Calling V0.1070 GB
Tinyllama 3T 128K JsonExtract062 GB
Tinyllama Sft Small050 GB
...nyllama Bnb 4bit Ft CodeAlpaca050 GB

Best Alternatives to Tinyllama Bnb 4bit

Best Alternatives
HF Rank
...nyllama Bnb 4bit Ft CodeAlpaca4K / 0.8 GB50
Palmer 003 Turbo 24012K / 0.8 GB101
Palmer 003 Turbo2K / 0.8 GB51
TinyLlama Pubmed V0 32K / 0.8 GB160

Tinyllama Bnb 4bit Parameters and Internals

LLM NameTinyllama Bnb 4bit
RepositoryOpen on ๐Ÿค— 
Model Size630.9m
Required VRAM0.8 GB
Model Typellama
Model Files  0.8 GB
Quantization Type4bit
Model ArchitectureLlamaForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.37.0.dev0
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32000
Initializer Range0.02
Torch Data Typebfloat16
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024022003