Linux As A Model 5M by mjbommar

 ยป  All LLMs  ยป  mjbommar  ยป  Linux As A Model 5M   URL Share it on

  Autotrain compatible   En   Endpoints compatible   Gpl2   Linux   Llama   Mit   Region:us   Safetensors

Linux As A Model 5M Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Linux As A Model 5M (mjbommar/linux-as-a-model-5M)

Linux As A Model 5M Parameters and Internals

Model Type 
text-generation
Use Cases 
Areas:
text generation
Applications:
Open Source Software
Primary Use Cases:
Memorization and generation of Linux 1.0 source code
Additional Notes 
This project aims to critique the OSI's stance on open-source AI models and data.
Supported Languages 
en (fluent)
Training Details 
Data Sources:
GPL2 source of the Linux kernel version 1.0
Data Volume:
Linux version 1.0
Methodology:
Simple transformer models to memorize the source code
Model Architecture:
Llama2 with 5 million parameters
LLM NameLinux As A Model 5M
Repository ๐Ÿค—https://huggingface.co/mjbommar/linux-as-a-model-5M 
Model Size5m
Required VRAM0 GB
Updated2025-02-05
Maintainermjbommar
Model Typellama
Model Files  0.0 GB
Supported Languagesen
Model ArchitectureLlamaForCausalLM
Licensemit
Context Length512
Model Max Length512
Transformers Version4.41.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|pad|>
Vocabulary Size32769
Torch Data Typefloat32

Best Alternatives to Linux As A Model 5M

Best Alternatives
Context / RAM
Downloads
Likes
Ko Llama 3.1 5B Instruct128K / 23.4 GB50
Llama 3.1 5B Instruct8K / 10.9 GB3397
Triangulum 5B8K / 10.9 GB1028
Triangulum 5B It8K / 10.9 GB658
Llama 3 5B Sheard8K / 11.7 GB99
Mermaid Llama 3 5B Pruned8K / 10.9 GB51
Ko Llama 230M 0317 5B2K / 0.6 GB1280
HelpingAI2.5 5B128K / 10.3 GB5602
HelpingAI2.5 5B128K / 10.3 GB612
Airoboros C34B 3.1.2 AWQ16K / 18.3 GB81
Note: green Score (e.g. "73.2") means that the model is better than mjbommar/linux-as-a-model-5M.

Rank the Linux As A Model 5M Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227