LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

GPT Neo 1.3B by EleutherAI

 »  All LLMs  »  EleutherAI  »  GPT Neo 1.3B   URL Share it on

  260256   
  Arxiv:2101.00027   Autotrain compatible   Dataset:eleutherai/pile   En   Endpoints compatible   Gpt neo   Jax   Pytorch   Region:us   Rust   Safetensors
Model Card on HF 🤗: https://huggingface.co/EleutherAI/gpt-neo-1.3B 

GPT Neo 1.3B Benchmarks

MMLU Pro: 1.82
GPQA: 0.78
MUSR: 4.87
BBH: 3.02
IFEval: 20.79 vs 88 (so35)-76.4%
ARC: 31.23 vs 96.7 (so35)-67.7%
HellaSwag: 48.47 vs 95.3 (gpt4)-49.1%
MMLU: 24.82 vs 88.3 (so35)-71.9%
TruthfulQA: 39.63 vs 59 (gpt4)-32.8%
WinoGrande: 56.91 vs 87.5 (gpt4)-35%
GSM8K: 0.45 vs 96.4 (so35)-99.5%
MATH Lvl 5: 1.06
LLME Score: 0.14449
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
GPT Neo 1.3B (EleutherAI/gpt-neo-1.3B)

GPT Neo 1.3B Parameters and Internals

Model Type 
text generation, causal-lm
Use Cases 
Areas:
text generation, research
Limitations:
May produce socially unacceptable content, Requires curation for quality and safety
Considerations:
Human curation is recommended
Additional Notes 
Evaluation results show competitive performance in multiple areas.
Supported Languages 
en (fluent)
Training Details 
Data Sources:
EleutherAI/pile
Data Volume:
380 billion tokens
Methodology:
trained as a masked autoregressive language model using cross-entropy loss
Training Time:
362,000 steps
Model Architecture:
transformer
Safety Evaluation 
Risk Categories:
profanity, lewd language
Ethical Considerations:
Model may produce socially unacceptable text
Responsible Ai Considerations 
Accountability:
Users should curate/filter outputs
Input Output 
Input Format:
Prompts in text format
Accepted Modalities:
text
Output Format:
Generated text sequences
LLM NameGPT Neo 1.3B
Repository 🤗https://huggingface.co/EleutherAI/gpt-neo-1.3B 
Model Size1.3b
Required VRAM5.3 GB
Updated2025-03-12
MaintainerEleutherAI
Model Typegpt_neo
Model Files  5.3 GB   5.3 GB
Supported Languagesen
Model ArchitectureGPTNeoForCausalLM
Licensemit
Context Length2048
Model Max Length2048
Transformers Version4.9.0.dev0
Tokenizer ClassGPT2Tokenizer
Vocabulary Size50257
Activation Functiongelu_new

Best Alternatives to GPT Neo 1.3B

Best Alternatives
Context / RAM
Downloads
Likes
GPT NEO 1.3B Wiki2K / 5.3 GB511
GPT Neo 1.3B Lama2K / 5.3 GB150
GPT Neo 1.3B Alpaca2K / 5.3 GB160
...ni Neo 1.3B Mental Health Lora2K / 1.6 GB18432
Adonalsium GPT Neo 1.3B2K / 0 GB1221
GPT Neo 1.3B Cs Finetuning2K / 0.5 GB100
GPT NeoX 1.3B Viet Long 702K / 5.3 GB810
...oX 1.3B Viet Custom 30 General2K / 5.3 GB740
GPT NeoX 1.3B Viet Custom 102K / 5.3 GB740
GPT NeoX 1.3B Viet Custom 302K / 5.3 GB740
Note: green Score (e.g. "73.2") means that the model is better than EleutherAI/gpt-neo-1.3B.

Rank the GPT Neo 1.3B Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 44902 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer