Zephyr 7B Beta 16K AWQ by NurtureAI

 ยป  All LLMs  ยป  NurtureAI  ยป  Zephyr 7B Beta 16K AWQ   URL Share it on

  Arxiv:2305.18290   Arxiv:2310.16944   4-bit   Autotrain compatible   Awq Base model:mistralai/mistral-7...   Conversational Dataset:huggingfaceh4/ultracha... Dataset:huggingfaceh4/ultrafee...   En   Endpoints compatible   Generated from trainer   License:mit   Mistral   Quantized   Region:us   Safetensors

Zephyr 7B Beta 16K AWQ Parameters and Internals

LLM NameZephyr 7B Beta 16K AWQ
RepositoryOpen on ๐Ÿค— 
Base Model(s)  mistralai/Mistral-7B-v0.1   mistralai/Mistral-7B-v0.1
Model Size7b
Required VRAM4.2 GB
Model Typemistral
Model Files  4.2 GB
Supported Languagesen
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureMistralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.35.1
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Torch Data Typefloat16
Zephyr 7B Beta 16K AWQ (NurtureAI/zephyr-7b-beta-16k-AWQ)

Best Alternatives to Zephyr 7B Beta 16K AWQ

Best Alternatives
HF Rank
Mistral 7B Instruct V0.3 AWQ0.332K / 4.2 GB21912
Breeze 7B Instruct V1.0 AWQ0.332K / 4.6 GB21211
Breeze 7B Instruct V1.0 AWQ0.332K / 4.6 GB5030
Mistral 7B Instruct V0.2 AWQ0.332K / 4.2 GB5901640
...ybaraHermes 2.5 Mistral 7B AWQ0.332K / 4.2 GB1702017
Ghost 7B Alpha AWQ0.332K / 4.2 GB3090
Mistroll 7B AWQ0.332K / 4.2 GB3990
Mistral 7B Instruct V0.3 AWQ0.332K / 4.2 GB490
Mistral 7B V0.3 AWQ0.332K / 4.2 GB1810
...Instruct V0.2 AWQ 4bit Smashed0.332K / 4.2 GB191
Note: green Score (e.g. "73.2") means that the model is better than NurtureAI/zephyr-7b-beta-16k-AWQ.

Rank the Zephyr 7B Beta 16K AWQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 34211 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024071601