Pygmalion 6B by PygmalionAI

 ยป  All LLMs  ยป  PygmalionAI  ยป  Pygmalion 6B   URL Share it on

  Autotrain compatible   Conversational   En   Gptj   Pytorch   Region:us   Sharded   Tensorboard

Pygmalion 6B Benchmarks

Pygmalion 6B (PygmalionAI/pygmalion-6b)

Pygmalion 6B Parameters and Internals

Model Type 
text generation
Use Cases 
Primary Use Cases:
dialogue model, requires specific input formatting
Limitations:
This model is NOT suitable for use by minors. It **will** output X-rated content under certain circumstances.
Additional Notes 
Proof-of-concept dialogue model; known for outputting X-rated content under specific circumstances.
Supported Languages 
en (English)
Training Details 
Data Sources:
the uft-6b ConvoGPT model, 56MB of dialogue data from multiple sources
Data Volume:
~48.5 million tokens
Methodology:
fine-tuning
Hardware Used:
4 NVIDIA A40s using DeepSpeed
Input Output 
Input Format:
[CHARACTER]'s Persona: [A few sentences about the character you want the model to play] [DIALOGUE HISTORY] You: [Your input message here] [CHARACTER]:
Accepted Modalities:
text
Output Format:
text
Performance Tips:
The model performs best if input prompts adhere to a specific format, including persona and dialogue history.
LLM NamePygmalion 6B
Repository ๐Ÿค—https://huggingface.co/PygmalionAI/pygmalion-6b 
Model Size6b
Required VRAM16.3 GB
Updated2024-12-22
MaintainerPygmalionAI
Model Typegptj
Model Files  10.4 GB: 1-of-2   5.9 GB: 2-of-2
Supported Languagesen
Model ArchitectureGPTJForCausalLM
Licensecreativeml-openrail-m
Model Max Length1024
Transformers Version4.26.0.dev0
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size50400
Torch Data Typefloat16
Activation Functiongelu_new
Errorsreplace

Best Alternatives to Pygmalion 6B

Best Alternatives
Context / RAM
Downloads
Likes
Test GPT J 6B0K / 2.5 GB9350
Deception Normal0K / 12.2 GB50
Deception Filteredpositive0K / 12.2 GB50
Gptj Allenai Toxicity Blackbox0K / 12.2 GB100
...j Allenai Toxicity Explainable0K / 12.2 GB170
GPT J 6B0K / 24.2 GB4211
GPT J 6B0K / 24.2 GB2131881456
Explainable GPT J 6B0K / 24.2 GB200
Pygmalion 6B Roleplay0K / 12.1 GB12102
Jeneri SAMA 6B0K / 12.2 GB141
Note: green Score (e.g. "73.2") means that the model is better than PygmalionAI/pygmalion-6b.

Rank the Pygmalion 6B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40066 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217