Taiwan LLM 8x7B DPO AWQ By yentinglin: Benchmarks, Features and Detailed Analysis. Insights on Taiwan LLM 8x7B DPO AWQ.

Arxiv:1910.09700 4-bit Autotrain compatible Awq Conversational Endpoints compatible Mixtral Moe Quantized Region:us Safetensors Sharded Tensorflow

Taiwan LLM 8x7B DPO AWQ Benchmarks

LLME Score: 0.20695

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Taiwan LLM 8x7B DPO AWQ Parameters and Internals

LLM Name	Taiwan LLM 8x7B DPO AWQ
Repository 🤗	https://huggingface.co/yentinglin/Taiwan-LLM-8x7B-DPO-awq
Model Size	6.5b
Required VRAM	24.7 GB
Updated	2024-09-29
Maintainer	yentinglin
Model Type	mixtral
Model Files	5.0 GB: 1-of-5 5.0 GB: 2-of-5 5.0 GB: 3-of-5 5.0 GB: 4-of-5 4.7 GB: 5-of-5
AWQ Quantization	Yes
Quantization Type	awq
Model Architecture	MixtralForCausalLM
Context Length	32768
Model Max Length	32768
Transformers Version	4.38.2
Tokenizer Class	LlamaTokenizer
Padding Token	</s>
Vocabulary Size	32002
Torch Data Type	float16

Taiwan LLM 8x7B DPO AWQ (yentinglin/Taiwan-LLM-8x7B-DPO-awq)

Best Alternatives to Taiwan LLM 8x7B DPO AWQ

Best Alternatives	Context / RAM	Downloads	Likes
Mixtral Instruct AWQ	32K / 24.7 GB	84399	42
Mixtral 8x7B Instruct V0.1 AWQ	32K / 24.7 GB	20484	15
Mixtral 8x7B Instruct V0.1 AWQ	32K / 24.7 GB	5387	57
Mixtral 8x7B Instruct V0.1 AWQ	32K / 24.7 GB	70	0
Dolphin 2.7 Mixtral 8x7b AWQ	32K / 24.7 GB	2925	20
...kaLM Mixtral 8x7B V0.2 DPO AWQ	32K / 24.7 GB	5	0
Karakuri Lm 8x7b Chat V0.1 AWQ	32K / 24.7 GB	23	0
Functionary Medium V2.4 AWQ	32K / 24.7 GB	19	3
H2ogpt Mixtral 8x7b 32K AWQ	32K / 24.7 GB	259	0
... Hermes 2 Mixtral 8x7B DPO AWQ	32K / 24.7 GB	275	21

Note: green Score (e.g. "73.2") means that the model is better than yentinglin/Taiwan-LLM-8x7B-DPO-awq.

Rank the Taiwan LLM 8x7B DPO AWQ Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 36371 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v2024072803

Support LLM Explorer

Taiwan LLM 8x7B DPO AWQ by yentinglin

» All LLMs » yentinglin » Taiwan LLM 8x7B DPO AWQ URL Share it on

Taiwan LLM 8x7B DPO AWQ Benchmarks

Taiwan LLM 8x7B DPO AWQ Parameters and Internals

Best Alternatives to Taiwan LLM 8x7B DPO AWQ

Rank the Taiwan LLM 8x7B DPO AWQ Capabilities

What open-source LLMs or SLMs are you in search of? 36371 in total.