Starling LM 7B Beta by Nexusflow

 ยป  All LLMs  ยป  Nexusflow  ยป  Starling LM 7B Beta   URL Share it on

  Arxiv:1909.08593   Autotrain compatible   Conversational   Dataset:berkeley-nest/nectar   En   Endpoints compatible   Mistral   Region:us   Reward model   Rlaif   Rlhf   Safetensors   Sharded   Tensorflow

Starling LM 7B Beta Benchmarks

Starling LM 7B Beta (Nexusflow/Starling-LM-7B-beta)

Starling LM 7B Beta Parameters and Internals

Model Type 
Language Model, finetuned with RLHF / RLAIF
Use Cases 
Considerations:
Please use the provided chat template to ensure optimal performance. The model can occasionally produce verbose outputs. Setting temperature to 0 can mitigate verbosity.
Additional Notes 
The model is hosted on LMSYS Chatbot Arena for free testing.
Supported Languages 
en (Proficient)
Training Details 
Data Sources:
berkeley-nest/Nectar
Methodology:
Trained by Reinforcement Learning from AI Feedback (RLAIF) with policy optimization method PPO.
Input Output 
Input Format:
Chat templates following Openchat-3.5-0106.
Accepted Modalities:
text
Output Format:
Text output based on input templates.
Performance Tips:
Follow the exact chat template for improved performance.
LLM NameStarling LM 7B Beta
Repository ๐Ÿค—https://huggingface.co/Nexusflow/Starling-LM-7B-beta 
Model Size7b
Required VRAM14.4 GB
Updated2024-12-26
MaintainerNexusflow
Model Typemistral
Model Files  4.9 GB: 1-of-3   5.0 GB: 2-of-3   4.5 GB: 3-of-3
Supported Languagesen
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.37.1
Tokenizer ClassLlamaTokenizer
Padding Token<|end_of_turn|>
Vocabulary Size32002
Torch Data Typebfloat16

Quantized Models of the Starling LM 7B Beta

Model
Likes
Downloads
VRAM
Starling LM 7B Beta AWQ3834 GB
Starling LM 7B Beta GPTQ4284 GB
Starling LM 7B Beta 4bit4144 GB
Starling LM 7B Beta 8bit2147 GB

Best Alternatives to Starling LM 7B Beta

Best Alternatives
Context / RAM
Downloads
Likes
...Nemo Instruct 2407 Abliterated1000K / 24.5 GB25749
MegaBeam Mistral 7B 512K512K / 14.4 GB681746
SpydazWeb AI HumanAI RP512K / 14.4 GB311
SpydazWeb AI HumanAI 002512K / 14.4 GB181
...daz Web AI ChatML 512K Project512K / 14.5 GB120
MegaBeam Mistral 7B 300K282K / 14.4 GB325215
Hebrew Mistral 7B 200K256K / 30 GB306115
Astral 256K 7B V2250K / 14.4 GB180
Astral 256K 7B250K / 14.4 GB150
Boptruth Agatha 7B128K / 14.4 GB4610

Rank the Starling LM 7B Beta Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40303 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227