LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Llama3 DiscoLeo Instruct 8B 32K V0.1 by DiscoResearch

 »  All LLMs  »  DiscoResearch  »  Llama3 DiscoLeo Instruct 8B 32K V0.1   URL Share it on

  422   
  Autotrain compatible   Conversational   De   Endpoints compatible   Instruct   Llama   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/DiscoResearch/Llama3-DiscoLeo-Instruct-8B-32k-v0.1 

Llama3 DiscoLeo Instruct 8B 32K V0.1 Benchmarks

LLME Score: 0.20182
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Llama3 DiscoLeo Instruct 8B 32K V0.1 (DiscoResearch/Llama3-DiscoLeo-Instruct-8B-32k-v0.1)

Llama3 DiscoLeo Instruct 8B 32K V0.1 Parameters and Internals

Model Type 
instruction-tuned, long-context
Use Cases 
Areas:
Research, Commercial applications
Supported Languages 
German (high proficiency)
Training Details 
Data Sources:
ociglot-fineweb-v0.5, DiscoLM German dataset
Data Volume:
65 billion high-quality German tokens + 100 million tokens at 32k context length
Methodology:
Full fine-tuning with axolotl
Context Length:
32768
Hardware Used:
42 supercomputer at hessian.Ai
Model Architecture:
Similar to LeoLM and Occiglot models
Input Output 
Input Format:
Use Llama-3 chat template with <role, content> format
Accepted Modalities:
text
Output Format:
Text output
Performance Tips:
Use appropriate GPU to leverage full potential
LLM NameLlama3 DiscoLeo Instruct 8B 32K V0.1
Repository 🤗https://huggingface.co/DiscoResearch/Llama3-DiscoLeo-Instruct-8B-32k-v0.1 
Model Size8b
Required VRAM16.1 GB
Updated2025-02-22
MaintainerDiscoResearch
Model Typellama
Instruction-BasedYes
Model Files  5.0 GB: 1-of-4   5.0 GB: 2-of-4   4.9 GB: 3-of-4   1.2 GB: 4-of-4
Supported Languagesde
Model ArchitectureLlamaForCausalLM
Licensellama3
Context Length65536
Model Max Length65536
Transformers Version4.40.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128256
Torch Data Typebfloat16

Quantized Models of the Llama3 DiscoLeo Instruct 8B 32K V0.1

Model
Likes
Downloads
VRAM
... Instruct 8B 32K V0.1 4bit AWQ0845 GB

Best Alternatives to Llama3 DiscoLeo Instruct 8B 32K V0.1

Best Alternatives
Context / RAM
Downloads
Likes
...a 3 8B Instruct Gradient 1048K1024K / 16.1 GB3927680
Mpasila Viking 8B1024K / 16.1 GB840
Hel V2 8B DARK FICTION1024K / 16.1 GB220
161024K / 16.1 GB1690
...di95 LewdStorytellerMix 8B 64K1024K / 16.1 GB692
Because Im Bored Nsfw11024K / 16.1 GB361
121024K / 16.1 GB600
MrRoboto ProLong 8B V4b1024K / 16.1 GB1070
MrRoboto ProLong 8B V1a1024K / 16.1 GB1080
MrRoboto ProLong 8B V2a1024K / 16.1 GB1020
Note: green Score (e.g. "73.2") means that the model is better than DiscoResearch/Llama3-DiscoLeo-Instruct-8B-32k-v0.1.

Rank the Llama3 DiscoLeo Instruct 8B 32K V0.1 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer