Breeze 7B 32K Instruct V1.0 by MediaTek-Research

 ยป  All LLMs  ยป  MediaTek-Research  ยป  Breeze 7B 32K Instruct V1.0   URL Share it on

  Arxiv:2403.02712   Autotrain compatible   Conversational   En   Endpoints compatible   Instruct   License:apache-2.0   Mistral   Pytorch   Region:us   Safetensors   Sharded   Zh

Rank the Breeze 7B 32K Instruct V1.0 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Breeze 7B 32K Instruct V1.0 (MediaTek-Research/Breeze-7B-32k-Instruct-v1_0)

Best Alternatives to Breeze 7B 32K Instruct V1.0

Best Alternatives
HF Rank
...1 Summarize 64K LoRANET Merged128K / 14.4 GB100
...0.2 Neuron 1x2048 2 Cores 2.1832K /  GB201
...uct V0.2 Neuron 1x2048 2 Cores32K /  GB41
...uct V0.1 Neuron 1x2048 2 Cores32K /  GB11650
Mistral Neuron32K /  GB4120
... V0.2 Seqlen 2048 Bs 1 Cores 232K /  GB1730
Mistral 7B Instruct V0.132K /  GB980
...ct V0.1 Neuron 4x2048 24 Cores32K /  GB70
TheDevilsDaughter32K / 0 GB490
Sq Mistral 7B Instruct W3 S032K / 3.2 GB41

Breeze 7B 32K Instruct V1.0 Parameters and Internals

LLM NameBreeze 7B 32K Instruct V1.0
RepositoryOpen on ๐Ÿค— 
Model Size7b
Required VRAM15 GB
Model Typemistral
Model Files  5.0 GB: 1-of-4   4.9 GB: 2-of-4   4.6 GB: 3-of-4   0.5 GB: 4-of-4
Supported Languageszh en
Model ArchitectureMistralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.38.0
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size62464
Initializer Range0.02
Torch Data Typebfloat16

What open-source LLMs or SLMs are you in search of? 35549 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801