Mamba 2.8B Slimpj by state-spaces

 ยป  All LLMs  ยป  state-spaces  ยป  Mamba 2.8B Slimpj   URL Share it on

  Arxiv:2312.00752   Endpoints compatible   Pytorch   Region:us

Mamba 2.8B Slimpj Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Mamba 2.8B Slimpj (state-spaces/mamba-2.8b-slimpj)

Mamba 2.8B Slimpj Parameters and Internals

Model Type 
language model
Additional Notes 
To load the model, follow the installation instructions in the code repository.
Training Details 
Data Sources:
SlimPajama
Data Volume:
600B tokens
Model Architecture:
Mamba
LLM NameMamba 2.8B Slimpj
Repository ๐Ÿค—https://huggingface.co/state-spaces/mamba-2.8b-slimpj 
Model Size2.8b
Required VRAM11.1 GB
Updated2025-02-22
Maintainerstate-spaces
Model Files  11.1 GB
Model ArchitectureAutoModel
Licenseapache-2.0
Vocabulary Size50277

Best Alternatives to Mamba 2.8B Slimpj

Best Alternatives
Context / RAM
Downloads
Likes
Mamba 2.8B0K / 11.1 GB11608146
Synatra Mamba Ko 2.8B0K / 5.8 GB591
Mamba Chat 2.8B0K / 5.5 GB493
Mamba 2.8B Instruct Openhermes0K / 5.5 GB8371
Mamba 2.8B CyberSec0K / 5.5 GB449
Bagel DPO 2.8B V0.20K / 11.1 GB1220
Bagel 2.8B V0.20K / 11.1 GB107
Mamba 2.8B Chat No Robots0K / 5.5 GB4615
...a Financial Headline Sentiment0K / 5.5 GB51
Ct2fast Pythia 2.8B0K / 5.5 GB51
Note: green Score (e.g. "73.2") means that the model is better than state-spaces/mamba-2.8b-slimpj.

Rank the Mamba 2.8B Slimpj Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227