Mpt 7B Int8 Ov by OpenVINO

 ยป  All LLMs  ยป  OpenVINO  ยป  Mpt 7B Int8 Ov   URL Share it on

  Autotrain compatible   Custom code   Mpt   Openvino   Region:us

Mpt 7B Int8 Ov Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Mpt 7B Int8 Ov Parameters and Internals

LLM NameMpt 7B Int8 Ov
Repository ๐Ÿค—https://huggingface.co/OpenVINO/mpt-7b-int8-ov 
Model Size7b
Required VRAM0 GB
Updated2024-10-30
MaintainerOpenVINO
Model Typempt
Model Files  0.0 GB   6.7 GB   0.0 GB
Model ArchitectureMPTForCausalLM
Licenseapache-2.0
Model Max Length2048
Transformers Version4.40.2
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50432
Torch Data Typebfloat16
Mpt 7B Int8 Ov (OpenVINO/mpt-7b-int8-ov)

Best Alternatives to Mpt 7B Int8 Ov

Best Alternatives
Context / RAM
Downloads
Likes
Mpt 7B0K / 13.3 GB414051160
Mpt 7B Chat0K / 13.3 GB5140512
Mpt 7B Storywriter0K / 13.3 GB2451820
Mpt 7B Instruct0K / 13.3 GB7787467
Shears Mpt 7B 50 Base0K / 13.3 GB821
Sea Lion 7B Instruct0K / 15 GB108223
Mpt 7B0K / 26.5 GB48051
Mpt 7B 8K0K / 13.3 GB181126
Sea Lion 7B0K / 15 GB79232
Mpt 7B 8K Chat0K / 13.3 GB143340
Note: green Score (e.g. "73.2") means that the model is better than OpenVINO/mpt-7b-int8-ov.

Rank the Mpt 7B Int8 Ov Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 37405 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072803