Internlm2 Limarp Chat 20B by intervitens

 ยป  All LLMs  ยป  intervitens  ยป  Internlm2 Limarp Chat 20B   URL Share it on

  Merged Model   Arxiv:2212.04089   Autotrain compatible Base model:finetune:interviten... Base model:intervitens/internl...   Dataset:lemonilia/limarp   En   Endpoints compatible   Llama   Region:us   Safetensors   Sharded   Tensorflow

Internlm2 Limarp Chat 20B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Internlm2 Limarp Chat 20B (intervitens/internlm2-limarp-chat-20b)

Internlm2 Limarp Chat 20B Parameters and Internals

Model Type 
text generation
Additional Notes 
Experimental model, uses mergekit for merging models
Supported Languages 
en (native)
Training Details 
Data Sources:
lemonilia/LimaRP
Methodology:
LimaRP LoRA trained on internlm2-base-20b and merged using task arithmetic
Context Length:
8192
Input Output 
Input Format:
ChatML
Accepted Modalities:
text
LLM NameInternlm2 Limarp Chat 20B
Repository ๐Ÿค—https://huggingface.co/intervitens/internlm2-limarp-chat-20b 
Base Model(s)  Internlm2 Base 20B Llama   intervitens/internlm2-base-20b-llama
Merged ModelYes
Model Size20b
Required VRAM39.6 GB
Updated2025-02-05
Maintainerintervitens
Model Typellama
Model Files  9.7 GB: 1-of-5   9.9 GB: 2-of-5   9.9 GB: 3-of-5   9.0 GB: 4-of-5   1.1 GB: 5-of-5
Supported Languagesen
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length32768
Model Max Length32768
Transformers Version4.36.2
Is Biased0
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size92544
Torch Data Typebfloat16

Best Alternatives to Internlm2 Limarp Chat 20B

Best Alternatives
Context / RAM
Downloads
Likes
Internlm2 5 20B Llamafied256K / 39.9 GB83
Internlm2 20B Llama32K / 39.6 GB122020
Stellaris Internlm2 20B R51232K / 39.8 GB53
Internlm2 Chat 20B Llama Old32K / 39.6 GB83
Internlm2 Base 20B Llama32K / 39.6 GB93
Internlm2 Base 20B Llama32K / 39.6 GB60
Deita 20B32K / 39.8 GB561
Bagel 20B V04 Llama32K / 39.6 GB47
Bagel DPO 20B V04 Llama32K / 39.6 GB83
Internlm2 Chat 20B Llama32K / 39.8 GB135
Note: green Score (e.g. "73.2") means that the model is better than intervitens/internlm2-limarp-chat-20b.

Rank the Internlm2 Limarp Chat 20B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227