LuminRP 13B 128K by Ppoyaa

 ยป  All LLMs  ยป  Ppoyaa  ยป  LuminRP 13B 128K   URL Share it on

  Autotrain compatible   Endpoints compatible   Frankenmoe   Lazymergekit   License:apache-2.0   Merge   Mergekit   Mixtral   Region:us   Safetensors   Sharded   Tensorflow

Rank the LuminRP 13B 128K Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
LuminRP 13B 128K (Ppoyaa/LuminRP-13B-128k)

Best Alternatives to LuminRP 13B 128K

Best Alternatives
HF Rank
13B MATH DPO32K / 25.8 GB27031
Eclipse 13B DPO32K / 25.8 GB27110
T3Q MSlerp 13B32K / 51.8 GB26740 7Bx2 MoE 13B 4.0bpw H6 EXL232K / 6.7 GB31 7Bx2 MoE 13B 6.0bpw H6 EXL232K / 9.8 GB33
WordWoven 13B GPTQ32K / 7.1 GB23
WordWoven 13B AWQ32K / 7.1 GB22

LuminRP 13B 128K Parameters and Internals

LLM NameLuminRP 13B 128K
RepositoryOpen on ๐Ÿค— 
Model Size13b
Required VRAM25.8 GB
Model Typemixtral
Model Files  1.9 GB: 1-of-13   2.0 GB: 2-of-13   2.0 GB: 3-of-13   2.0 GB: 4-of-13   2.0 GB: 5-of-13   2.0 GB: 6-of-13   2.0 GB: 7-of-13   2.0 GB: 8-of-13   2.0 GB: 9-of-13   2.0 GB: 10-of-13   2.0 GB: 11-of-13   2.0 GB: 12-of-13   1.9 GB: 13-of-13
Model ArchitectureMixtralForCausalLM
Context Length131072
Model Max Length131072
Transformers Version4.40.2
Tokenizer ClassLlamaTokenizer
Padding Token<s>
Vocabulary Size32000
Initializer Range0.02
Torch Data Typebfloat16

What open-source LLMs or SLMs are you in search of? 35549 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801