Hpc Coder V2.6.7B by hpcgroup

 »  All LLMs  »  hpcgroup  »  Hpc Coder V2.6.7B   URL Share it on

  Autotrain compatible   Axonn   Code   Codegen   Dataset:hpcgroup/hpc-instruct Dataset:ise-uiuc/magicoder-oss... Dataset:nickrosh/evol-instruct...   En   Endpoints compatible   Hpc   Instruct   Llama   Parallel   Region:us   Safetensors   Sharded   Tensorflow

Hpc Coder V2.6.7B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Hpc Coder V2.6.7B Parameters and Internals

Model Type 
text-generation
Additional Notes 
Utilizes AxoNN for distributed training in parallel across GPUs
Training Details 
Data Sources:
hpcgroup/hpc-instruct, ise-uiuc/Magicoder-OSS-Instruct-75K, nickrosh/Evol-Instruct-Code-80k-v1
Methodology:
Fine-tuned on instruction dataset catered to common HPC topics
Input Output 
Input Format:
Formatted as instructions for instruct model
LLM NameHpc Coder V2.6.7B
Repository 🤗https://huggingface.co/hpcgroup/hpc-coder-v2-6.7b 
Model Size6.7b
Required VRAM27.1 GB
Updated2024-11-22
Maintainerhpcgroup
Model Typellama
Instruction-BasedYes
Model Files  4.8 GB: 1-of-6   4.9 GB: 2-of-6   4.9 GB: 3-of-6   4.9 GB: 4-of-6   4.9 GB: 5-of-6   2.7 GB: 6-of-6
Supported Languagesen
Generates CodeYes
Model ArchitectureLlamaForCausalLM
Context Length16384
Model Max Length16384
Transformers Version4.39.0.dev0
Tokenizer ClassLlamaTokenizer
Padding Token<|end▁of▁sentence|>
Vocabulary Size32256
Torch Data Typefloat32
Hpc Coder V2.6.7B (hpcgroup/hpc-coder-v2-6.7b)

Best Alternatives to Hpc Coder V2.6.7B

Best Alternatives
Context / RAM
Downloads
Likes
...s Coder6.7b Reflct Adamw Iter116K / 13.5 GB3200
Speechless Coder Ds 6.7B16K / 13.5 GB12685
Code 290K 6.7B Instruct16K / 13.5 GB876
Datascience Coder 6.7B16K / 13.5 GB12453
Merge Code Gen16K / 13.6 GB140
... 6.7B Instruct Trt Int4 G64 Hf16K / 4.2 GB60
...6.7B Instruct Trt Int8 G128 Hf16K / 7.2 GB60
NaturalSQL 6.7B V016K / 13.5 GB6346
SQL Sorcerer 6.7B V1.116K / 13.5 GB80
DeepYi Second16K / 12.6 GB170
Note: green Score (e.g. "73.2") means that the model is better than hpcgroup/hpc-coder-v2-6.7b.

Rank the Hpc Coder V2.6.7B Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 38199 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241110