L3 8B Celeste V1.2 by nothingiisreal

 ยป  All LLMs  ยป  nothingiisreal  ยป  L3 8B Celeste V1.2   URL Share it on

  Autotrain compatible   Conversational Dataset:nothingiisreal/c2-logs... Dataset:nothingiisreal/claude-... Dataset:nothingiisreal/reddit-...   En   Endpoints compatible   Instruct   Llama   Llama-factory   Not-for-all-audiences   Region:us   Safetensors   Sharded   Tensorflow

L3 8B Celeste V1.2 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
L3 8B Celeste V1.2 (nothingiisreal/L3-8B-Celeste-V1.2)

L3 8B Celeste V1.2 Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
roleplay, creative writing
Primary Use Cases:
roleplay, story generation
Limitations:
May not adhere to specific narrative structures without guidance.
Considerations:
OOC steering and fewshot methodologies are recommended.
Additional Notes 
The model is versatile in style but may require initial message corrections to maintain format.
Supported Languages 
en (high)
Training Details 
Data Sources:
r/WritingPrompts, r/DirtyWritingPrompts, Opus Instruct 15K, c2 logs cleaned
Data Volume:
~8000 characters max per first assistant reply
Methodology:
Increasing amount of ranks from 64 to 256, using GGUF and EXL2 quantization
Context Length:
8000
Training Time:
2.5 hours
Hardware Used:
4xH100 NVL
Model Architecture:
LLaMA 3 8B
Responsible Ai Considerations 
Transparency:
The transparency of data and training methodology is prioritized in this release.
Accountability:
Developers 'nothingiisreal' are accountable.
Mitigation Strategies:
The model is designed to sometimes refuse romantic advances as a measure of realism.
Input Output 
Input Format:
text prompts
Accepted Modalities:
text
Output Format:
text
Performance Tips:
Use OOC steering and sampling settings for best results.
Release Notes 
Version:
1.2
Notes:
Improved from V1 with enhanced coherence and roleplay abilities.
LLM NameL3 8B Celeste V1.2
Repository ๐Ÿค—https://huggingface.co/nothingiisreal/L3-8B-Celeste-V1.2 
Model Size8b
Required VRAM16.1 GB
Updated2025-02-05
Maintainernothingiisreal
Model Typellama
Instruction-BasedYes
Model Files  5.0 GB: 1-of-4   5.0 GB: 2-of-4   4.9 GB: 3-of-4   1.2 GB: 4-of-4
Supported Languagesen
Model ArchitectureLlamaForCausalLM
Licensellama3
Context Length8192
Model Max Length8192
Transformers Version4.42.4
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|eot_id|>
Vocabulary Size128256
Torch Data Typebfloat16

Best Alternatives to L3 8B Celeste V1.2

Best Alternatives
Context / RAM
Downloads
Likes
...a 3 8B Instruct Gradient 1048K1024K / 16.1 GB6623678
Mpasila Viking 8B1024K / 16.1 GB590
161024K / 16.1 GB1690
Because Im Bored Nsfw11024K / 16.1 GB661
121024K / 16.1 GB600
MrRoboto ProLong 8B V4b1024K / 16.1 GB1070
MrRoboto ProLong 8B V1a1024K / 16.1 GB1080
MrRoboto ProLong 8B V2a1024K / 16.1 GB1020
MrRoboto ProLong 8B V4c1024K / 16.1 GB870
8B Unaligned BASE V2b1024K / 16.1 GB980
Note: green Score (e.g. "73.2") means that the model is better than nothingiisreal/L3-8B-Celeste-V1.2.

Rank the L3 8B Celeste V1.2 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227