LLM Explorer: A Curated Large Language Model Directory and Analytics  // 

Air Striker Mixtral 8x7B ZLoss 3.75bpw H6 EXL2 by LoneStriker

What open-source LLMs or SLMs are you in search of? 18732 in total.

  4-bit   Autotrain compatible Dataset:jondurbin/airoboros-3....   En   Exl2   License:apache-2.0   Lora   Mixtral   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Rank the Air Striker Mixtral 8x7B ZLoss 3.75bpw H6 EXL2 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Air Striker Mixtral 8x7B ZLoss 3.75bpw H6 EXL2 (LoneStriker/Air-Striker-Mixtral-8x7B-ZLoss-3.75bpw-h6-exl2)

Best Alternatives to Air Striker Mixtral 8x7B ZLoss 3.75bpw H6 EXL2

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
...nsloth 4bit Mistral Imdb Model0K / 0.2 GB100
Tiny Llama Miniguanaco2K / 2.2 GB11
Try0K /  GB80
Ailawyer0K / 0 GB32
Ailawyer0K / 0 GB22
Financial Summary20K / 0 GB71
Law Llama2.20K / 0 GB51
Phi 1 5 Finetuned Gsm8k0K / 0 GB41
Horror0K / 0 GB31
Oka0K / 0 GB31

Air Striker Mixtral 8x7B ZLoss 3.75bpw H6 EXL2 Parameters and Internals

LLM NameAir Striker Mixtral 8x7B ZLoss 3.75bpw H6 EXL2
RepositoryOpen on ๐Ÿค— 
Required VRAM22.2 GB
Updated2024-02-21
MaintainerLoneStriker
Model Files  8.6 GB: 1-of-3   8.6 GB: 2-of-3   5.0 GB: 3-of-3
Supported Languagesen
Quantization Typeexl2
Model ArchitectureAutoModelForCausalLM
Licenseapache-2.0
Is Biasednone
Tokenizer ClassLlamaTokenizer
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesq_proj|w1|v_proj|gate|o_proj|w3|k_proj|w2
LoRA Alpha16
LoRA Dropout0.07
R Param64
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024022003