Mamba Chat 2.8B by ayoubkirouane

 ยป  All LLMs  ยป  ayoubkirouane  ยป  Mamba Chat 2.8B   URL Share it on

  En   Endpoints compatible   Mamba   Pytorch   Region:us

Mamba Chat 2.8B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Mamba Chat 2.8B (ayoubkirouane/Mamba-Chat-2.8B)

Mamba Chat 2.8B Parameters and Internals

Model Type 
state-space model (SSM)
Use Cases 
Areas:
NLP tasks, Audio analysis, Genomics
Applications:
Text summarization, Question answering, Dialogue systems
Considerations:
Still in the early stages of development, requiring further experimentation for reliability.
Additional Notes 
Mamba-Chat departs from transformer architecture, adopting a state-space model framework, promising efficiency, speed, and valuable use across diverse fields.
Supported Languages 
en (full proficiency)
Training Details 
Data Sources:
HuggingFaceH4/ultrachat_200k
Methodology:
Selective State Spaces methodology for sequence modeling
Hardware Used:
16,000 samples from the HuggingFaceH4/ultrachat_200k dataset
Model Architecture:
State-space model with selective state spaces
Input Output 
Input Format:
input_ids generated from the chat template
Accepted Modalities:
text
Output Format:
decoded text message
Performance Tips:
Model's performance and reliability may benefit from further experimentation.
LLM NameMamba Chat 2.8B
Repository ๐Ÿค—https://huggingface.co/ayoubkirouane/Mamba-Chat-2.8B 
Model Size2.8b
Required VRAM5.5 GB
Updated2025-02-22
Maintainerayoubkirouane
Model Files  5.5 GB
Supported Languagesen
Model ArchitectureAutoModel
Licenseapache-2.0
Tokenizer ClassGPTNeoXTokenizer
Padding Token<|endoftext|>
Vocabulary Size50277

Best Alternatives to Mamba Chat 2.8B

Best Alternatives
Context / RAM
Downloads
Likes
Mamba 2.8B0K / 11.1 GB11608146
Mamba 2.8B Slimpj0K / 11.1 GB2268123
Synatra Mamba Ko 2.8B0K / 5.8 GB591
Mamba 2.8B Instruct Openhermes0K / 5.5 GB8371
Mamba 2.8B CyberSec0K / 5.5 GB449
Bagel DPO 2.8B V0.20K / 11.1 GB1220
Bagel 2.8B V0.20K / 11.1 GB107
Mamba 2.8B Chat No Robots0K / 5.5 GB4615
...a Financial Headline Sentiment0K / 5.5 GB51
Ct2fast Pythia 2.8B0K / 5.5 GB51
Note: green Score (e.g. "73.2") means that the model is better than ayoubkirouane/Mamba-Chat-2.8B.

Rank the Mamba Chat 2.8B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227