Merlinite 7B Ocp4.15 V0.1 by boricua

 ยป  All LLMs  ยป  boricua  ยป  Merlinite 7B Ocp4.15 V0.1   URL Share it on

  Autotrain compatible   En   Endpoints compatible   F16   Ggml   Gguf   Mistral   Q4   Quantized   Region:us   Safetensors

Merlinite 7B Ocp4.15 V0.1 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Merlinite 7B Ocp4.15 V0.1 (boricua/merlinite-7b-ocp4.15-v0.1)

Merlinite 7B Ocp4.15 V0.1 Parameters and Internals

Model Type 
Fine-tuned
Additional Notes 
Model is trained on synthetic data and needs to be handled cautiously due to risks of disinformation.
Supported Languages 
en ()
Training Details 
Data Sources:
OpenShift 4.15 documentation
Data Volume:
28606 Q&A pairs
Methodology:
Generated 5 Q&A pairs for each page on OpenShift (OCP) 4.15 PDFs, evaluated quality of Q&A using Mistral-7B-Instruct-v0.2 and tweaked with Mixtral-8x22B-Instruct-v0.1. Removed low quality Q&A pairs and non-informative ones.
Responsible Ai Considerations 
Mitigation Strategies:
The model shouldn't be entirely relied upon for crucial decisions due to risks of generating disinformation.
LLM NameMerlinite 7B Ocp4.15 V0.1
Repository ๐Ÿค—https://huggingface.co/boricua/merlinite-7b-ocp4.15-v0.1 
Model Size7b
Required VRAM4.4 GB
Updated2025-02-22
Maintainerboricua
Model Typemistral
Model Files  4.4 GB   14.5 GB   14.5 GB
Supported Languagesen
GGML QuantizationYes
GGUF QuantizationYes
Quantization Typeggml|q4|gguf|q4_k
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.38.2
Padding Token<|pad|>
Vocabulary Size32008
Torch Data Typebfloat16

Best Alternatives to Merlinite 7B Ocp4.15 V0.1

Best Alternatives
Context / RAM
Downloads
Likes
Mistrilitary 7B32K / 7.7 GB12819
Mistral Scary Story Finetune32K / 14.5 GB300
Mistral 7B V0.2 Csn SFT32K / 14.4 GB150
AzzurroQuantized32K / 4.4 GB3334
Instruct 16bit32K / 0.4 GB50
Merlinite 7B Ocp4.15 V0.332K / 14.5 GB90
Shiftdocs 7B Ocp4.15 V0.332K / 14.5 GB110
AzzurroQuantized32K / 4.4 GB2224
Filiberto 7B Instruct Exp132K / 14.5 GB310
MistralMusic32K / 14.4 GB261
Note: green Score (e.g. "73.2") means that the model is better than boricua/merlinite-7b-ocp4.15-v0.1.

Rank the Merlinite 7B Ocp4.15 V0.1 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227