SeQwence 14Bv1 by CultriX

 ยป  All LLMs  ยป  CultriX  ยป  SeQwence 14Bv1   URL Share it on

  Merged Model   Arxiv:2306.01708   Arxiv:2311.03099   Autotrain compatible Base model:cultrix/qwen2.5-14b... Base model:cultrix/qwen2.5-14b... Base model:cultrix/seqwence-14...   Base model:qwen/qwen2.5-14b Base model:v000000/qwen2.5-lum... Base model:vagosolutions/sauer...   Conversational   En   Endpoints compatible   Qwen2   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF ๐Ÿค—: https://huggingface.co/CultriX/SeQwence-14Bv1 

SeQwence 14Bv1 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
SeQwence 14Bv1 (CultriX/SeQwence-14Bv1)

SeQwence 14Bv1 Parameters and Internals

LLM NameSeQwence 14Bv1
Repository ๐Ÿค—https://huggingface.co/CultriX/SeQwence-14Bv1 
Base Model(s)  SeQwence 14B   SauerkrautLM V2 14B DPO   v000000/Qwen2.5-Lumen-14B   CultriX/Qwen2.5-14B-Wernicke   Qwen/Qwen2.5-14B   CultriX/Qwen2.5-14B-MegaMerge-pt2   CultriX/SeQwence-14B   VAGOsolutions/SauerkrautLM-v2-14b-DPO   v000000/Qwen2.5-Lumen-14B   CultriX/Qwen2.5-14B-Wernicke   Qwen/Qwen2.5-14B   CultriX/Qwen2.5-14B-MegaMerge-pt2
Merged ModelYes
Model Size14b
Required VRAM29.7 GB
Updated2024-12-06
MaintainerCultriX
Model Typeqwen2
Model Files  4.9 GB: 1-of-6   5.0 GB: 2-of-6   5.0 GB: 3-of-6   5.0 GB: 4-of-6   5.0 GB: 5-of-6   4.8 GB: 6-of-6
Supported Languagesen
Model ArchitectureQwen2ForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.46.3
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151665
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to SeQwence 14Bv1

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2.5 14B128K / 29.6 GB2701743
SeQwence 14B128K / 29.7 GB1283
Virtuoso Small128K / 29.6 GB29730
SuperNova Medius128K / 29.7 GB9392191
Qwen2.5 14B Uncencored128K / 29.7 GB72
Rombos LLM V2.6 Qwen 14B128K / 29.7 GB519947
EVA Qwen2.5 14B V0.2128K / 29.7 GB34713
Miscii 14B 1028128K / 29.6 GB16913
Qwen2.5 14B Wernicke128K / 29.7 GB12824
Lamarck 14B V0.1 Experimental128K / 29.7 GB271
Note: green Score (e.g. "73.2") means that the model is better than CultriX/SeQwence-14Bv1.

Rank the SeQwence 14Bv1 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 38920 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124