Openchat 3.5 0106 by openchat

 ยป  All LLMs  ยป  openchat  ยป  Openchat 3.5 0106   URL Share it on

  Arxiv:2303.08774   Arxiv:2309.11235   Autotrain compatible Base model:finetune:mistralai/... Base model:mistralai/mistral-7...   C-rlft   Conversational   Endpoints compatible   Mistral   Openchat   Region:us   Safetensors   Sharded   Tensorflow

Openchat 3.5 0106 Benchmarks

Openchat 3.5 0106 Parameters and Internals

LLM NameOpenchat 3.5 0106
RepositoryOpen on ๐Ÿค— 
Base Model(s)  mistralai/Mistral-7B-v0.1   mistralai/Mistral-7B-v0.1
Model Size7b
Required VRAM14.4 GB
Updated2024-07-27
Maintaineropenchat
Model Typemistral
Model Files  4.9 GB: 1-of-3   5.0 GB: 2-of-3   4.5 GB: 3-of-3
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.36.1
Tokenizer ClassLlamaTokenizer
Vocabulary Size32002
Torch Data Typebfloat16
Openchat 3.5 0106 (openchat/openchat-3.5-0106)

Quantized Models of the Openchat 3.5 0106

Model
Likes
Downloads
VRAM
Openchat 3.5 0106 GGUF7026463 GB
Openchat 3.5 0106 GGUF0773 GB
MasherAI 7B V1 GGUF0104 GB
MasherAI 7B V0.9 GGUF0124 GB
Openchat 3.5 0106 GGUF01712 GB
Openchat 3.5 0106 AWQ52184 GB
OpenChat 3.5 0106 GGUF22233 GB
Openchat 3.5 0106 GPTQ61184 GB
Newton 7B 8.0bpw H8 EXL21147 GB
Openchat 3.5 0106 GPTQ1234 GB

Best Alternatives to Openchat 3.5 0106

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
MegaBeam Mistral 7B 300K0.3282K / 14.4 GB205715
Hebrew Mistral 7B 200K0.3256K / 30 GB209115
Astral 256K 7B V20.2250K / 14.4 GB2390
Astral 256K 7B0.2250K / 14.4 GB2330
Buddhi 128K Chat 7B0.3128K / 14.4 GB61214
LuminRP 7B 128K V0.20.3128K / 14.4 GB2610
...1 Summarize 64K LoRANET Merged0.2128K / 14.4 GB2320
... Summarize 64K QLoRANET Merged0.2128K / 4.1 GB80
LuminRP 7B 128K V0.50.2128K / 14.5 GB91
LuminRP 7B 128K V0.40.2128K / 14.4 GB121

Rank the Openchat 3.5 0106 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 34447 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072501