Mpt 7B Storywriter 4bit 128g 65kTokens CPU by DanielAWrightGabrielAI

 ยป  All LLMs  ยป  DanielAWrightGabrielAI  ยป  Mpt 7B Storywriter 4bit 128g 65kTokens CPU   URL Share it on

  4bit   Autotrain compatible   Custom code   Mpt   Quantized   Region:us

Mpt 7B Storywriter 4bit 128g 65kTokens CPU Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Mpt 7B Storywriter 4bit 128g 65kTokens CPU (DanielAWrightGabrielAI/mpt-7b-storywriter-4bit-128g-65kTokens-CPU)

Mpt 7B Storywriter 4bit 128g 65kTokens CPU Parameters and Internals

Model Type 
Text-Generation, Conversational, Uncensored
Additional Notes 
Model can extrapolate even beyond 65k tokens. Not fully finished or tested.
LLM NameMpt 7B Storywriter 4bit 128g 65kTokens CPU
Repository ๐Ÿค—https://huggingface.co/DanielAWrightGabrielAI/mpt-7b-storywriter-4bit-128g-65kTokens-CPU 
Model Size7b
Required VRAM3.9 GB
Updated2024-12-22
MaintainerDanielAWrightGabrielAI
Model Typempt
Model Files  3.9 GB
Quantization Type4bit
Model ArchitectureMPTForCausalLM
Licenseapache-2.0
Model Max Length65536
Transformers Version4.28.1
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50432
Torch Data Typebfloat16

Best Alternatives to Mpt 7B Storywriter 4bit 128g 65kTokens CPU

Best Alternatives
Context / RAM
Downloads
Likes
Mpt 7B Chat Q80K / 6.9 GB221
Mpt 7B Storywriter Q80K / 6.9 GB242
Mpt 7B Instruct Q80K / 6.9 GB192
Mpt 7B Q80K / 6.9 GB231
Mpt 7B Storywriter 4bit 128g0K / 3.9 GB81125
Mpt 7B Storywriter 4bit 128g0K / 3.9 GB3422
Mpt 7B0K / 13.3 GB298221164
Mpt 7B Chat0K / 13.3 GB20372512
Mpt 7B Storywriter0K / 13.3 GB1694824
Mpt 7B Instruct0K / 13.3 GB7997468
Note: green Score (e.g. "73.2") means that the model is better than DanielAWrightGabrielAI/mpt-7b-storywriter-4bit-128g-65kTokens-CPU.

Rank the Mpt 7B Storywriter 4bit 128g 65kTokens CPU Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40066 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217