LLM Explorer: A Curated Large Language Model Directory and Analytics  // 

LightGPT by amazon

What open-source LLMs or SLMs are you in search of? 18732 in total.

 ยป  All LLMs  ยป  amazon  ยป  LightGPT   URL Share it on

  Autotrain compatible   En   Gptj   Has space   License:apache-2.0   Pytorch   Region:us

Rank the LightGPT Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
LightGPT (amazon/LightGPT)

Best Alternatives to LightGPT

Best Alternatives
HF Rank
GPT J 6B Int8 Dynamic Inc0K /  GB71116
GPT J 6B Int8 Dynamic0K /  GB68316
GPT J 6B Int8 Static0K /  GB529
GPT J 6B Int8 Static Inc0K /  GB519
GPT J 6B Onnx0K /  GB350
GPT J 6B Adventure0K / 6.1 GB400
GPT J 6B Skein0K / 6.1 GB280
GPT J 6B Buckland0K / 6.2 GB61
GPT J 6B Shakespeare0K / 6.2 GB31
GPT J 6B Pytorch Int8 Static0K / 6.7 GB420

LightGPT Parameters and Internals

LLM NameLightGPT
RepositoryOpen on ๐Ÿค— 
Model Size6b
Required VRAM12.2 GB
Model Typegptj
Model Files  12.2 GB   0.0 GB
Supported Languagesen
Model ArchitectureGPTJForCausalLM
Model Max Length2048
Transformers Version4.27.4
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size50400
Initializer Range0.02
Torch Data Typefloat16
Activation Functiongelu_new
Attention Dropout0
Embedding Dropout0
Layer Norm Epsilon1.0E-5
Summary First Dropout0.1
Summary Typecls_index
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024022003