Oneirogen 0.5B by gustavecortal

 ยป  All LLMs  ยป  gustavecortal  ยป  Oneirogen 0.5B   URL Share it on

  Merged Model   Autotrain compatible   Conversational Dataset:gustavecortal/dreamban...   En   Endpoints compatible   Qwen2   Region:us   Safetensors

Oneirogen 0.5B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Oneirogen 0.5B (gustavecortal/oneirogen-0.5B)

Oneirogen 0.5B Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
research, dream analysis
Applications:
Generating novel dream narratives, Predicting character and emotion in dream narratives
Additional Notes 
Oneirogen was used to produce 'The Android and The Machine', an English dataset composed of 10,000 real and 10,000 generated dreams.
Supported Languages 
en (Proficient)
Training Details 
Data Sources:
DreamBank corpus
Data Volume:
More than 27,000 dream narratives
Methodology:
Finetuned using LoRA adaptation
Model Architecture:
Qwen2
Input Output 
Input Format:
Text prompting with 'Dream:' as prefix
Accepted Modalities:
text
Output Format:
Generated dream narratives with 'END.' as stopping criterion
Performance Tips:
Fine-tune on specific annotations like Hall and Van de Castle for enhanced use cases
LLM NameOneirogen 0.5B
Repository ๐Ÿค—https://huggingface.co/gustavecortal/oneirogen-0.5B 
Merged ModelYes
Model Size0.5b
Required VRAM1 GB
Updated2025-01-17
Maintainergustavecortal
Model Typeqwen2
Model Files  1.0 GB
Supported Languagesen
Model ArchitectureQwen2ForCausalLM
Licensemit
Context Length131072
Model Max Length131072
Transformers Version4.41.2
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Torch Data Typefloat16
Errorsreplace

Best Alternatives to Oneirogen 0.5B

Best Alternatives
Context / RAM
Downloads
Likes
Reader Lm 0.5B250K / 1 GB516136
Qwen2 0.5B128K / 1 GB137136123
...PRYMMAL 0.5B FT V4 MUSR Mathis128K / 1 GB621
...0.5B FT EnhancedMUSREnsembleV3128K / 1 GB321
....5B FT V4 MUSR ENSEMBLE Mathis128K / 2 GB301
...0.5B FT MUSR ENSEMBLE V2Mathis128K / 1 GB250
ECE PRYMMAL 0.5B FT V3 MUSR128K / 2 GB120
Qwen2 0.5B128K / 1 GB50472
ECE PRYMMAL 0.5B FT V4 MUSR128K / 2 GB150
...0.5B FT EnhancedMUSREnsembleV3128K / 1 GB151
Note: green Score (e.g. "73.2") means that the model is better than gustavecortal/oneirogen-0.5B.

Rank the Oneirogen 0.5B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 41537 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227