OLMo 7B Instruct by allenai

 ยป  All LLMs  ยป  allenai  ยป  OLMo 7B Instruct   URL Share it on

  Arxiv:2402.00838   Autotrain compatible   Conversational   Custom code   Dataset:allenai/dolma Dataset:allenai/tulu-v2-sft-mi... Dataset:allenai/ultrafeedback ...   En   Hf olmo   Instruct   Pytorch   Region:us   Safetensors   Sharded   Tensorflow

OLMo 7B Instruct Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
OLMo 7B Instruct (allenai/OLMo-7B-Instruct)

OLMo 7B Instruct Parameters and Internals

Model Type 
Transformer style autoregressive language model
Use Cases 
Areas:
Research, Commercial applications
Primary Use Cases:
Question answering
Considerations:
Model can still generate harmful or sensitive content
Additional Notes 
This is the instruct variant, newer versions available.
Supported Languages 
English (native)
Training Details 
Data Sources:
allenai/dolma, allenai/tulu-v2-sft-mixture, allenai/ultrafeedback_binarized_cleaned
Data Volume:
Variety, details in specific dataset documentations
Methodology:
Uses SFT + DPO methods
Context Length:
2048
Model Architecture:
Based on base model OLMo with adaptations
Input Output 
Input Format:
Text
Accepted Modalities:
text
Output Format:
Text response
Performance Tips:
Use quantization for inference efficiency
LLM NameOLMo 7B Instruct
Repository ๐Ÿค—https://huggingface.co/allenai/OLMo-7B-Instruct 
Model Size7b
Required VRAM13.7 GB
Updated2025-02-18
Maintainerallenai
Model Typehf_olmo
Instruction-BasedYes
Model Files  9.9 GB: 1-of-2   3.8 GB: 2-of-2   9.9 GB: 1-of-2   3.8 GB: 2-of-2
Supported Languagesen
Model ArchitectureOLMoForCausalLM
Licenseapache-2.0
Transformers Version4.35.0.dev0
Tokenizer ClassOLMoTokenizer
Padding Token<|padding|>
Vocabulary Size50280
Torch Data Typebfloat16

Rank the OLMo 7B Instruct Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43267 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227