Codegen 6B Lora by mhhmm

 ยป  All LLMs  ยป  mhhmm  ยป  Codegen 6B Lora   URL Share it on

  Autotrain compatible   Codegen   Dataset:deepmind/code contests Dataset:mhhmm/leetcode-solutio...   En   Endpoints compatible   Lora   Region:us
Model Card on HF ๐Ÿค—: https://huggingface.co/mhhmm/codegen-6B-lora 

Codegen 6B Lora Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Codegen 6B Lora (mhhmm/codegen-6B-lora)

Codegen 6B Lora Parameters and Internals

Model Type 
text-generation
Use Cases 
Areas:
research, coding assistance
Applications:
code generation, algorithm implementation
Primary Use Cases:
coding solutions to problems like TwoSum
Additional Notes 
Model was fine-tuned using Peft with LoRA using specific datasets for coding tasks.
Supported Languages 
en (proficient)
Training Details 
Data Sources:
mhhmm/leetcode-solutions-python, deepmind/code_contests
Methodology:
fine-tuned with LoRA on targeted datasets for code generation tasks
Training Time:
~2 hours on Google Colab Pro+
Hardware Used:
Google Colab Pro+
Input Output 
Input Format:
Code snippets for transformation or enhancement
Accepted Modalities:
text, code
Output Format:
Generated code in text format
LLM NameCodegen 6B Lora
Repository ๐Ÿค—https://huggingface.co/mhhmm/codegen-6B-lora 
Model Size6b
Required VRAM0 GB
Updated2025-02-05
Maintainermhhmm
Model Files  0.0 GB
Supported Languagesen
Generates CodeYes
Model ArchitectureAutoModelForCausalLM
Licensemit
Is Biasednone
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesq_proj|v_proj
LoRA Alpha32
LoRA Dropout0.05
R Param16

Rank the Codegen 6B Lora Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227