LLM Explorer: A Curated Large Language Model Directory and Analytics  // 

LightGPT by amazon

What open-source LLMs or SLMs are you in search of? 18732 in total.

 ยป  All LLMs  ยป  amazon  ยป  LightGPT   URL Share it on

  Autotrain compatible   En   Gptj   Has space   License:apache-2.0   Pytorch   Region:us

Rank the LightGPT Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
LightGPT (amazon/LightGPT)

Best Alternatives to LightGPT

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
GPT J 6B Int8 Dynamic Inc0K /  GB71116
GPT J 6B Int8 Dynamic0K /  GB68316
GPT J 6B Int8 Static0K /  GB529
GPT J 6B Int8 Static Inc0K /  GB519
GPT J 6B Onnx0K /  GB350
GPT J 6B Adventure0K / 6.1 GB400
GPT J 6B Skein0K / 6.1 GB280
GPT J 6B Buckland0K / 6.2 GB61
GPT J 6B Shakespeare0K / 6.2 GB31
GPT J 6B Pytorch Int8 Static0K / 6.7 GB420

LightGPT Parameters and Internals

LLM NameLightGPT
RepositoryOpen on ๐Ÿค— 
Model Size6b
Required VRAM12.2 GB
Updated2024-02-21
Maintaineramazon
Model Typegptj
Model Files  12.2 GB   0.0 GB
Supported Languagesen
Model ArchitectureGPTJForCausalLM
Licenseapache-2.0
Model Max Length2048
Transformers Version4.27.4
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size50400
Initializer Range0.02
Torch Data Typefloat16
Activation Functiongelu_new
Attention Dropout0
Embedding Dropout0
Layer Norm Epsilon1.0E-5
Summary First Dropout0.1
Summary Typecls_index
Errorsreplace
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024022003