LCARS AI 1x2 001 12B by LeroyDyer

 ยป  All LLMs  ยป  LeroyDyer  ยป  LCARS AI 1x2 001 12B   URL Share it on

  Autotrain compatible   Bio   Code   Codegen   Conversational   Cyber   Cyber-series   En   Endpoints compatible   Law   License:apache-2.0   Medical   Merge   Mixtral   Mixture-of-experts   Moe   Region:us   Safetensors   Sft   Sharded   Tensorflow   Trl

LCARS AI 1x2 001 12B Parameters and Internals

Model Type 
Mixture-Of-Experts, language model, text generation
Use Cases 
Areas:
coding, medical, bio, cybersecurity
Applications:
programming support, medical inference, long-context data handling, transformer model tasks
Primary Use Cases:
chat models, roleplay, instructional tasks, function calling
Additional Notes 
The MEGA_MIND 24b CyberSeries integrates diversified expert models into a unified framework.
Supported Languages 
en (high)
Training Details 
Data Sources:
OpenOrca dataset, Mistral-7B-v0.2, PubMed Central Open Access
Data Volume:
large
Methodology:
Mixture of Experts, Reinforcement Learning from AI Feedback
Context Length:
128000
Model Architecture:
Mixture of Experts, Transformer-based
LLM NameLCARS AI 1x2 001 12B
Repository ๐Ÿค—https://huggingface.co/LeroyDyer/LCARS_AI_1x2_001_12B 
Model Size12b
Required VRAM25.5 GB
Updated2024-07-04
MaintainerLeroyDyer
Model Typemixtral
Model Files  4.0 GB: 1-of-7   3.9 GB: 2-of-7   3.9 GB: 3-of-7   3.9 GB: 4-of-7   3.9 GB: 5-of-7   3.9 GB: 6-of-7   2.0 GB: 7-of-7
Supported Languagesen
Generates CodeYes
Model ArchitectureMixtralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.38.2
Tokenizer ClassLlamaTokenizer
Padding Token<s>
Vocabulary Size32000
Torch Data Typefloat16

Rank the LCARS AI 1x2 001 12B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227