Self Correct Ministral8Bit MMQA DPO Iter1 by RyanYr

 ยป  All LLMs  ยป  RyanYr  ยป  Self Correct Ministral8Bit MMQA DPO Iter1   URL Share it on

  Arxiv:2305.18290   Autotrain compatible Base model:finetune:mistralai/... Base model:mistralai/ministral...   Conversational   Dpo   Endpoints compatible   Generated from trainer   Instruct   Mistral   Region:us   Safetensors   Sharded   Tensorflow   Trl

Self Correct Ministral8Bit MMQA DPO Iter1 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Self Correct Ministral8Bit MMQA DPO Iter1 (RyanYr/self-correct_ministral8Bit_mMQA_dpo_iter1)

Self Correct Ministral8Bit MMQA DPO Iter1 Parameters and Internals

LLM NameSelf Correct Ministral8Bit MMQA DPO Iter1
Repository ๐Ÿค—https://huggingface.co/RyanYr/self-correct_ministral8Bit_mMQA_dpo_iter1 
Model Nameself-correct_mistral8Bit_mMQA_dpo_iter1
Base Model(s)  Ministral 8B Instruct 2410   mistralai/Ministral-8B-Instruct-2410
Model Size8b
Required VRAM60.8 GB
Updated2024-11-15
MaintainerRyanYr
Model Typemistral
Instruction-BasedYes
Model Files  5.0 GB: 1-of-4   4.9 GB: 1-of-9   5.0 GB: 2-of-4   5.0 GB: 2-of-9   5.0 GB: 3-of-4   5.0 GB: 3-of-9   1.1 GB: 4-of-4   4.9 GB: 4-of-9   5.0 GB: 5-of-9   5.0 GB: 6-of-9   4.9 GB: 7-of-9   5.0 GB: 8-of-9   5.0 GB: 9-of-9   0.0 GB
Model ArchitectureMistralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.45.2
Tokenizer ClassLlamaTokenizer
Padding Token[PAD]
Vocabulary Size131073
Torch Data Typebfloat16

Best Alternatives to Self Correct Ministral8Bit MMQA DPO Iter1

Best Alternatives
Context / RAM
Downloads
Likes
Ministral 8B Instruct 2410 HF32K / 32 GB5101510
Ministrations 8B V132K / 16.1 GB14315
Ministral 8B Slerp32K / 29.2 GB270
...flect Mini8Bit Om2 460k Sft T132K / 16.1 GB1300
...ruct 2410 MetaMathQA DPO Iter132K / 16.1 GB3870
...t Ministral8Bit MMQA Mix Iter232K / 16.1 GB1320
...ect Ministral8Bit Mg DPO Psdp232K / 16.1 GB690
...t Ministral8Bit Math DPO Iter132K / 16.1 GB530
...t Ministral8Bit MMQA DPO Iter132K / 16.1 GB420
...ruct 2410 MetaMathQA DPO Iter232K / 16.1 GB780
Note: green Score (e.g. "73.2") means that the model is better than RyanYr/self-correct_ministral8Bit_mMQA_dpo_iter1.

Rank the Self Correct Ministral8Bit MMQA DPO Iter1 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 40066 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241217