Openchat 3.5 0106 GGUF by zeio

 ยป  All LLMs  ยป  zeio  ยป  Openchat 3.5 0106 GGUF   URL Share it on

  Arxiv:2303.08774   Arxiv:2309.11235   Autotrain compatible Base model:openchat/openchat-3...   C-rlft   Gguf   License:apache-2.0   Mistral   Openchat   Pytorch   Quantized   Region:us

Openchat 3.5 0106 GGUF Benchmarks

Rank the Openchat 3.5 0106 GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Openchat 3.5 0106 GGUF (zeio/openchat-3.5-0106-GGUF)

Best Alternatives to Openchat 3.5 0106 GGUF

Best Alternatives
HF Rank
...nated Proof 7b V1.0 Safetensor81.144K / 14.4 GB140510
Contaminated Proof 7b V1.081.144K / 14.4 GB13104
YamshadowExperiment28 7B76.8632K / 14.4 GB173015
M7 7B76.8232K / 14.4 GB746211
MultiverseEx26 7B Slerp76.832K / 14.4 GB7760
NeuralSynthesis 7B V0.176.832K / 14.5 GB11321
Percival 01 7B Slerp76.7932K / 14.4 GB25442
...periment27Multi Verse Model 7B76.7732K / 14.4 GB10950
NeuralSynthesis 7B V0.4 Slerp76.7632K / 14.5 GB3300
Maxine 7B 0401 Stock76.7332K / 14.4 GB12101
Note: green Score (e.g. "73.2") means that the model is better than zeio/openchat-3.5-0106-GGUF.

Openchat 3.5 0106 GGUF Parameters and Internals

LLM NameOpenchat 3.5 0106 GGUF
RepositoryOpen on ๐Ÿค— 
Model NameOpenchat 3.5 0106
Model CreatorOpenChat
Base Model(s)  Openchat 3.5 0106   openchat/openchat-3.5-0106
Model Size7b
Required VRAM3.1 GB
Model Typemistral
Model Files  3.1 GB   3.8 GB   3.5 GB   3.2 GB   4.1 GB   4.4 GB   4.1 GB   5.0 GB   5.1 GB   5.0 GB   5.9 GB   7.7 GB   7.7 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureMistralForCausalLM
Context Length8192
Model Max Length8192
Transformers Version4.34.1
Vocabulary Size32002
Initializer Range0.02
Torch Data Typebfloat16

What open-source LLMs or SLMs are you in search of? 35526 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20240042001