Minicpm 2B Sft Bf16 Llamafied 16K by NurtureAI

 ยป  All LLMs  ยป  NurtureAI  ยป  Minicpm 2B Sft Bf16 Llamafied 16K   URL Share it on

  Autotrain compatible   Conversational   En   Endpoints compatible   Llama   Minicpm   Modelbest   Region:us   Safetensors   Sharded   Tensorflow   Thunlp   Zh

Minicpm 2B Sft Bf16 Llamafied 16K Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Minicpm 2B Sft Bf16 Llamafied 16K (NurtureAI/minicpm-2b-sft-bf16-llamafied-16k)

Minicpm 2B Sft Bf16 Llamafied 16K Parameters and Internals

Model Type 
text generation, multimodal
Use Cases 
Areas:
Research, Commercial applications
Applications:
Text generation, Code generation
Primary Use Cases:
Multimodal applications, Smartphone deployment
Limitations:
Model may experience hallucinations due to size, Prompt sensitivity, Inconsistent results
Considerations:
Evaluation and verifying output is the user's responsibility.
Additional Notes 
MiniCPM's inference speed is significantly faster than human verbal speed when deployed on smartphones.
Supported Languages 
en (Proficient), zh (Proficient)
Training Details 
Methodology:
Special training methods include SFT and DPO on MiniCPM-2B. Parameter efficient finetuning can be conducted with low resource GPUs.
Input Output 
Input Format:
Standard prompt input
Accepted Modalities:
text, image
Output Format:
text
Performance Tips:
Specify the data type in 'from_pretrained' to avoid computation errors.
LLM NameMinicpm 2B Sft Bf16 Llamafied 16K
Repository ๐Ÿค—https://huggingface.co/NurtureAI/minicpm-2b-sft-bf16-llamafied-16k 
Model Size2b
Required VRAM6 GB
Updated2024-12-08
MaintainerNurtureAI
Model Typellama
Model Files  5.0 GB: 1-of-2   1.0 GB: 2-of-2
Supported Languagesen zh
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length16384
Model Max Length16384
Transformers Version4.36.2
Tokenizer ClassLlamaTokenizer
Vocabulary Size122753
Torch Data Typebfloat16

Best Alternatives to Minicpm 2B Sft Bf16 Llamafied 16K

Best Alternatives
Context / RAM
Downloads
Likes
Llama 2B Hf 32768 Fpf32K / 3.8 GB1751
YuLan Mini28K / 4.8 GB32235
Salamandra 2B8K / 4.5 GB1027722
SmolLM2 MedIT Upscale 2B8K / 4.2 GB84
Salamandra 2B Instruct8K / 4.5 GB298918
Sarvam 2B V0.58K / 5.1 GB63483
Test Quantized8K / 5.8 GB760
EPFL TA Meister Quantized V18K / 5.8 GB780
Llama3 2B Base8K / 4.7 GB831
Llama3 Rommie8K / 5.8 GB760
Note: green Score (e.g. "73.2") means that the model is better than NurtureAI/minicpm-2b-sft-bf16-llamafied-16k.

Rank the Minicpm 2B Sft Bf16 Llamafied 16K Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227