StableLManticore 7B by openaccess-ai-collective

 ยป  All LLMs  ยป  openaccess-ai-collective  ยป  StableLManticore 7B   URL Share it on

  Autotrain compatible   Endpoints compatible   Gpt neox   Pytorch   Region:us   Sharded

StableLManticore 7B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
StableLManticore 7B (openaccess-ai-collective/StableLManticore-7B)

StableLManticore 7B Parameters and Internals

Additional Notes 
The model was an experimental trial to see the plausibility of training with current tools. It has poor support for SFT with the Hugging Face trainer and lacks features like flash attention, making it inefficient. Usability is limited despite possibilities with LoRA.
Training Details 
Methodology:
Experiment using LoRA
LLM NameStableLManticore 7B
Repository ๐Ÿค—https://huggingface.co/openaccess-ai-collective/StableLManticore-7B 
Model Size7b
Required VRAM16 GB
Updated2025-02-22
Maintaineropenaccess-ai-collective
Model Typegpt_neox
Model Files  10.1 GB: 1-of-2   5.9 GB: 2-of-2
Model ArchitectureGPTNeoXForCausalLM
Context Length4096
Model Max Length4096
Transformers Version4.30.0.dev0
Vocabulary Size50432
Torch Data Typefloat16

Best Alternatives to StableLManticore 7B

Best Alternatives
Context / RAM
Downloads
Likes
Literature 7B 1638416K / 36 GB1714
RedPajama 7B 1638416K / 36 GB144
Stablelm Tuned Alpha 7B4K / 31.9 GB5819360
Stablelm Base Alpha 7B4K / 31.9 GB2613209
Stablelm 7B Sft V7 Epoch 34K / 32.4 GB202567
Pythia 6.9B Deduped 4K4K / 27.2 GB910
Stablelm 7B4K / 31.9 GB72
Sarashina1 7B2K / 13.9 GB3380
Dolly V2 7B2K / 13.8 GB11366149
Open Calm 7B2K / 13.9 GB3471206
Note: green Score (e.g. "73.2") means that the model is better than openaccess-ai-collective/StableLManticore-7B.

Rank the StableLManticore 7B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227