LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Nemo 12B Marlin V5 by UsernameJustAnother

 »  All LLMs  »  UsernameJustAnother  »  Nemo 12B Marlin V5   URL Share it on

  17   
  Autotrain compatible Base model:finetune:unsloth/mi... Base model:unsloth/mistral-nem...   Conversational   En   Endpoints compatible   Experimental   Gguf   Instruct   Long-context   Mistral   Region:us   Rp   Safetensors   Sharded   Tensorflow   Trl   Unsloth
Model Card on HF 🤗: https://huggingface.co/UsernameJustAnother/Nemo-12B-Marlin-v5 

Nemo 12B Marlin V5 Benchmarks

LLME Score: 0.21432
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Nemo 12B Marlin V5 (UsernameJustAnother/Nemo-12B-Marlin-v5)

Nemo 12B Marlin V5 Parameters and Internals

Model Type 
text-generation-inference, transformers, trl, experimental, long-context
Additional Notes 
Trained using Unsloth and Huggingface's TRL library for faster finetuning and larger batch sizes.
Supported Languages 
en (unknown proficiency)
Training Details 
Data Sources:
human-generated conversations of varying lengths from a variety of sources
Data Volume:
10,801 examples
Methodology:
RP finetune using ChatML format
Training Time:
5 hours
Hardware Used:
single Colab A100
Model Architecture:
FastLanguageModel.get_peft_model with LoRA
LLM NameNemo 12B Marlin V5
Repository 🤗https://huggingface.co/UsernameJustAnother/Nemo-12B-Marlin-v5 
Base Model(s)  Mistral Nemo Instruct 2407   unsloth/Mistral-Nemo-Instruct-2407
Model Size12b
Required VRAM24.5 GB
Updated2025-01-15
MaintainerUsernameJustAnother
Model Typemistral
Instruction-BasedYes
Model Files  4.9 GB: 1-of-5   4.9 GB: 2-of-5   4.9 GB: 3-of-5   4.9 GB: 4-of-5   4.9 GB: 5-of-5
Supported Languagesen
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length1024000
Model Max Length1024000
Transformers Version4.43.3
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<pad>
Vocabulary Size131072
Torch Data Typebfloat16

Best Alternatives to Nemo 12B Marlin V5

Best Alternatives
Context / RAM
Downloads
Likes
...r Nemo 12B Instruct R 21 09 241000K / 24.5 GB920799
SauerkrautLM Nemo 12B Instruct1000K / 24.5 GB569922
Mistral Nemo Wissenschaft 12B1000K / 24.5 GB49856
Magnum V4 12B1000K / 24.5 GB69437
MN Slush1000K / 24.5 GB18014
ChatWaifu 12B V2.01000K / 24.5 GB10918
ChatWaifu V1.41000K / 24.5 GB4316
...tral Nemo Gutenberg Doppel 12B1000K / 24.5 GB624
Mistral Nemo Bophades 12B1000K / 24.5 GB808
...stral Nemo Gutenberg2 12B Test1000K / 24.5 GB161
Note: green Score (e.g. "73.2") means that the model is better than UsernameJustAnother/Nemo-12B-Marlin-v5.

Rank the Nemo 12B Marlin V5 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 41418 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer