CodeOptimus Instruct Mistral 7B V0.1.gguf by Jaward

 ยป  All LLMs  ยป  Jaward  ยป  CodeOptimus Instruct Mistral 7B V0.1.gguf   URL Share it on

  Adapter   Conversational   Endpoints compatible   Finetuned   Gguf   Instruct   Lora   Quantized   Region:us   Safetensors

CodeOptimus Instruct Mistral 7B V0.1.gguf Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
CodeOptimus Instruct Mistral 7B V0.1.gguf (Jaward/CodeOptimus-Instruct-Mistral-7B-v0.1.gguf)

CodeOptimus Instruct Mistral 7B V0.1.gguf Parameters and Internals

Model Type 
supervised instruction fine-tuning
Additional Notes 
Includes a RAG Module for real-time updates to the knowledge base
Training Details 
Data Sources:
code_instructions_122k_alpaca_style, custom curated dataset
Methodology:
Supervised fine-tuning using qLora
Training Time:
1 week
Hardware Used:
7 Nvidia A100s
LLM NameCodeOptimus Instruct Mistral 7B V0.1.gguf
Repository ๐Ÿค—https://huggingface.co/Jaward/CodeOptimus-Instruct-Mistral-7B-v0.1.gguf 
Model Size7b
Required VRAM0 GB
Updated2025-02-05
MaintainerJaward
Instruction-BasedYes
Model Files  5.1 GB   0.1 GB   0.0 GB   0.0 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAdapter
Licensemit
Is Biasednone
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesdown_proj|v_proj|o_proj|up_proj|k_proj|gate_proj|q_proj
LoRA Alpha32
LoRA Dropout0.05
R Param8

Best Alternatives to CodeOptimus Instruct Mistral 7B V0.1.gguf

Best Alternatives
Context / RAM
Downloads
Likes
Lemonilia ShoriRP V0.75d0K / 0.2 GB41
Mistral Numericnlg FV0K / 0.3 GB50
Mistral Wikitable FV0K / 0.3 GB50
Mistral Charttotext FV0K / 0.3 GB50
Zephyr 7B Beta Agent Instruct0K / 0.3 GB111
Falcon 7B Instruct 4bit Lora0K / 0 GB01
Qwen Megumin0K / 0.1 GB130
Deepthink Reasoning Adapter0K / 0.2 GB398
Mistral Finetuned Bookcorpus0K / 0 GB500
Mistral 7B Instruct Sa V0.10K / 0 GB60
Note: green Score (e.g. "73.2") means that the model is better than Jaward/CodeOptimus-Instruct-Mistral-7B-v0.1.gguf.

Rank the CodeOptimus Instruct Mistral 7B V0.1.gguf Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227