Mistral DNA V1.1.6B Hg38 by RaphaelMourad

 ยป  All LLMs  ยป  RaphaelMourad  ยป  Mistral DNA V1.1.6B Hg38   URL Share it on

  Autotrain compatible   Dna   Endpoints compatible   Mistral   Mixtral   Moe   Pretrained   Region:us   Safetensors

Mistral DNA V1.1.6B Hg38 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Mistral DNA V1.1.6B Hg38 (RaphaelMourad/Mistral-DNA-v1-1.6B-hg38)

Mistral DNA V1.1.6B Hg38 Parameters and Internals

Model Type 
pretrained, generative, DNA sequence
Additional Notes 
Mistral-DNA-v1-1.6B-hg38 is a pretrained base model for DNA.
Training Details 
Data Sources:
10kb DNA sequences from the hg38 human genome assembly
Model Architecture:
Transformer with Grouped-Query Attention, Sliding-Window Attention, Byte-fallback BPE tokenizer, Mixture of Experts
LLM NameMistral DNA V1.1.6B Hg38
Repository ๐Ÿค—https://huggingface.co/RaphaelMourad/Mistral-DNA-v1-1.6B-hg38 
Model Size1.6b
Required VRAM0 GB
Updated2024-11-22
MaintainerRaphaelMourad
Model Typemixtral
Model Files  3.2 GB   0.0 GB   0.0 GB
Model ArchitectureMixtralForCausalLM
Licenseapache-2.0
Context Length512
Model Max Length512
Transformers Version4.41.0
Tokenizer ClassPreTrainedTokenizerFast
Padding Token[PAD]
Vocabulary Size4096
Torch Data Typebfloat16

Best Alternatives to Mistral DNA V1.1.6B Hg38

Best Alternatives
Context / RAM
Downloads
Likes
Mistral Prot V1.1.6B0.5K / 0 GB210
Mistral Chem V1.1.6B0.5K / 0 GB180
Note: green Score (e.g. "73.2") means that the model is better than RaphaelMourad/Mistral-DNA-v1-1.6B-hg38.

Rank the Mistral DNA V1.1.6B Hg38 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227