GPT Neo 1.3B Dutch by yhavinga

 ยป  All LLMs  ยป  yhavinga  ยป  GPT Neo 1.3B Dutch   URL Share it on

  Autotrain compatible Dataset:yhavinga/mc4 nl cleane...   Endpoints compatible   Gpt-neo   Gpt-neo-1.3b   Gpt neo   Jax   Nl   Pytorch   Region:us   Safetensors   Tensorboard

GPT Neo 1.3B Dutch Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
GPT Neo 1.3B Dutch (yhavinga/gpt-neo-1.3B-dutch)

GPT Neo 1.3B Dutch Parameters and Internals

Model Type 
text generation
Additional Notes 
This project was supported by Google TPU Research Cloud and utilized HuggingFace tools extensively.
Supported Languages 
Dutch (native)
Training Details 
Data Sources:
cleaned Dutch mC4
Data Volume:
33B tokens
Methodology:
Trained from scratch for Dutch
Context Length:
512
Training Time:
7 days 11 hours
Hardware Used:
Google TPU through TPU Research Cloud
Model Architecture:
GPT-Neo, similar to GPT-3 but open-source
Input Output 
Input Format:
Text
Accepted Modalities:
text
Output Format:
Generated text
Release Notes 
Version:
1.3B
Notes:
Initial release of the Dutch GPT-Neo model with 1.3 billion parameters.
LLM NameGPT Neo 1.3B Dutch
Repository ๐Ÿค—https://huggingface.co/yhavinga/gpt-neo-1.3B-dutch 
Model Size1.3b
Required VRAM5.4 GB
Updated2025-05-12
Maintaineryhavinga
Model Typegpt_neo
Model Files  5.4 GB   5.4 GB
Supported Languagesnl
Model ArchitectureGPTNeoForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.13.0
Tokenizer ClassGPT2Tokenizer
Vocabulary Size50257
Torch Data Typefloat32
Activation Functiongelu_new

Best Alternatives to GPT Neo 1.3B Dutch

Best Alternatives
Context / RAM
Downloads
Likes
GPT NEO 1.3B Wiki2K / 5.3 GB81
GPT Neo 1.3B Lama2K / 5.3 GB170
GPT Neo 1.3B Alpaca2K / 5.3 GB170
...ni Neo 1.3B Mental Health Lora2K / 1.6 GB162
Adonalsium GPT Neo 1.3B2K / 0 GB91
GPT Neo 1.3B Cs Finetuning2K / 0.5 GB50
GPT Neo 1.3B2K / 5.3 GB222314300
GlorIA 1.3B2K / 5.4 GB23230
GPT NeoX 1.3B Viet Long 702K / 5.3 GB70
...oX 1.3B Viet Custom 30 General2K / 5.3 GB50
Note: green Score (e.g. "73.2") means that the model is better than yhavinga/gpt-neo-1.3B-dutch.

Rank the GPT Neo 1.3B Dutch Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 47272 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227