Ct2fast Codet5p 770M by michaelfeil

 ยป  All LLMs  ยป  michaelfeil  ยป  Ct2fast Codet5p 770M   URL Share it on

  Arxiv:2305.07922   Ctranslate2   Endpoints compatible   Float16   Int8   Region:us

Ct2fast Codet5p 770M Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Ct2fast Codet5p 770M (michaelfeil/ct2fast-codet5p-770m)

Ct2fast Codet5p 770M Parameters and Internals

Model Type 
encoder-decoder, encoder-only, decoder-only
Use Cases 
Areas:
research, commercial applications
Applications:
code understanding, code generation
Primary Use Cases:
text-to-code generation, code completion, text-to-code retrieval, code retrieval-augmented generation
Additional Notes 
Performance gains observed in zero-shot, finetuning, and instruction-tuning settings.
Supported Languages 
c (high), c++ (high), c-sharp (high), go (high), java (high), javascript (high), php (high), python (high), ruby (high)
Training Details 
Data Sources:
github-code dataset
Data Volume:
stricter permissive subset
Methodology:
span denoising, causal language modeling, contrastive learning, text-code matching
Model Architecture:
shallow encoder and deep decoder
Input Output 
Input Format:
text
Accepted Modalities:
text
Output Format:
text
Performance Tips:
Utilizes quantized inference methods via CTranslate2 for efficiency.
Release Notes 
Version:
converted
Date:
2023-05-20
Notes:
Quantized version using CTranslate2 for efficient inference.
LLM NameCt2fast Codet5p 770M
Repository ๐Ÿค—https://huggingface.co/michaelfeil/ct2fast-codet5p-770m 
Model Size770m
Required VRAM1.5 GB
Updated2025-05-20
Maintainermichaelfeil
Model Files  1.5 GB
Model ArchitectureAutoModel
Licensebsd-3-clause
Model Max Length512
Tokenizer ClassRobertaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Errorsreplace

Best Alternatives to Ct2fast Codet5p 770M

Best Alternatives
Context / RAM
Downloads
Likes
Codet5p 770M Py Ct2 Int80K / 0.7 GB140
Ct2fast Codet5p 770M Py0K / 1.5 GB06
Note: green Score (e.g. "73.2") means that the model is better than michaelfeil/ct2fast-codet5p-770m.

Rank the Ct2fast Codet5p 770M Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 47442 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227