Kicon Mixtral87 Merged Torch212 by jerryyun

 ยป  All LLMs  ยป  jerryyun  ยป  Kicon Mixtral87 Merged Torch212   URL Share it on

  Merged Model   Arxiv:1910.09700   4-bit   Autotrain compatible   Bitsandbytes   Conversational   Endpoints compatible   Instruct   Mixtral   Moe   Region:us   Safetensors   Sharded   Tensorflow

Kicon Mixtral87 Merged Torch212 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Kicon Mixtral87 Merged Torch212 (jerryyun/kicon_mixtral87_merged_torch212)

Kicon Mixtral87 Merged Torch212 Parameters and Internals

LLM NameKicon Mixtral87 Merged Torch212
Repository ๐Ÿค—https://huggingface.co/jerryyun/kicon_mixtral87_merged_torch212 
Merged ModelYes
Model Size24.2b
Required VRAM26.7 GB
Updated2025-02-05
Maintainerjerryyun
Model Typemixtral
Instruction-BasedYes
Model Files  5.0 GB: 1-of-6   5.0 GB: 2-of-6   5.0 GB: 3-of-6   5.0 GB: 4-of-6   5.0 GB: 5-of-6   1.7 GB: 6-of-6
Model ArchitectureMixtralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.39.1
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Kicon Mixtral87 Merged Torch212

Best Alternatives
Context / RAM
Downloads
Likes
Proto Athena 4x7B32K / 48.4 GB80
Proto Athena V0.2 4x7B32K / 48.4 GB50
...erges MoE 4x7b V10 Mixtralv0.332K / 48.3 GB80
MoE Merging32K / 48.3 GB12140
Sixtyoneeighty 4x7B V132K / 48.3 GB520
MixtureofMerges MoE 4x7bRP V1132K / 48.3 GB81
Eclipse Mistral 4x7b32K / 48.5 GB161
Kicon Mixtral87 Merged 4176632K / 26.7 GB50
Boundary Mistral 4x7b MoE32K / 48.7 GB1171
...x7b Quantized Portuguese Luana32K / 26.7 GB501
Note: green Score (e.g. "73.2") means that the model is better than jerryyun/kicon_mixtral87_merged_torch212.

Rank the Kicon Mixtral87 Merged Torch212 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227