Qwen2-72B-Instruct: A Comparison with Llama3, WizardLM-2, and Command-R+
18/06/2024 09:50:26
Looking at our list of Top-trending models (ranked by downloads and likes based on information from Hugging Face and LLM Explorer), we can see that LLMs from the Qwen2 family have remained popular among the AI community over the past week.
A nice experience was shared within the AI community comparing Qwen2-72b-Instruct with Llama3, WizardLM-2, and Command-R-+. Here are their findings:
In many areas, Qwen2 performed as well or better than the others. For creative few-shot tasks, the models were tested by creating problem-oriented teaching introductions to mathematical topics. Command-R-+ struggled with this task, while Llama3 often lacked relevance. WizardLM completed the task but was not very creative. Qwen2 excelled, providing the best performance by a clear margin, and will replace WizardLM in this area.
When creating self-study worksheets, Llama3 produced worksheets with good structure but unclear instructions, requiring extensive revision. WizardLM created well-structured worksheets with well-chosen numbers. However, Qwen2's worksheets were even more refined and effective at engaging students.
About the Model Qwen2-72B-Instruct supports up to 131,072 tokens, allowing for processing extensive inputs. Qwen2 is a versatile language model series with various sizes, featuring advanced Transformer architecture and an improved tokenizer for multiple languages. The models are pretrained on extensive data and fine-tuned with supervised training and direct preference optimization.
License Information The Tongyi Qianwen LICENSE AGREEMENT, effective August 3, 2023, outlines the terms for using, reproducing, distributing, and modifying the materials. By using these materials, you agree to the terms. You get a non-exclusive, worldwide, royalty-free license. Commercial use with over 100 million monthly active users requires a license from Alibaba Cloud. Alibaba Cloud retains all intellectual property rights. The materials are provided "as is" without warranty, and Alibaba Cloud is not liable for any damages. This Agreement is governed by the laws of China, with jurisdiction in the People's Courts in Hangzhou City.
Recent Blog Posts
-
2024-08-03