LLM Explorer: A Curated Large Language Model Directory and Analytics  // 

TinyStories Instruct 3M by roneneldan

What open-source LLMs or SLMs are you in search of? 18732 in total.

 ยป  All LLMs  ยป  roneneldan  ยป  TinyStories Instruct 3M   URL Share it on

  Autotrain compatible   Endpoints compatible   Gpt neo   Instruct   Pytorch   Region:us

Rank the TinyStories Instruct 3M Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
TinyStories Instruct 3M (roneneldan/TinyStories-Instruct-3M)

TinyStories Instruct 3M Parameters and Internals

LLM NameTinyStories Instruct 3M
RepositoryOpen on ๐Ÿค— 
Model Size3m
Required VRAM0.1 GB
Model Typegpt_neo
Model Files  0.1 GB
Model ArchitectureGPTNeoForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.28.1
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size50257
Initializer Range0.02
Torch Data Typefloat32
Activation Functiongelu_new
Layer Norm Epsilon1.0E-5
Summary First Dropout0.1
Summary Typecls_index
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024022003