Llama 2B Hf 32768 Fpf by mesolitica

 ยป  All LLMs  ยป  mesolitica  ยป  Llama 2B Hf 32768 Fpf   URL Share it on

  Autotrain compatible   Endpoints compatible   Llama   Ms   Region:us   Safetensors

Llama 2B Hf 32768 Fpf Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Llama 2B Hf 32768 Fpf (mesolitica/llama-2b-hf-32768-fpf)

Llama 2B Hf 32768 Fpf Parameters and Internals

Model Type 
Text Generation
Supported Languages 
Malaysian (Proficient)
Training Details 
Methodology:
Derived from first 5 layers
Context Length:
32768
LLM NameLlama 2B Hf 32768 Fpf
Repository ๐Ÿค—https://huggingface.co/mesolitica/llama-2b-hf-32768-fpf 
Model Size2b
Required VRAM3.8 GB
Updated2025-02-16
Maintainermesolitica
Model Typellama
Model Files  3.8 GB
Supported Languagesms
Model ArchitectureLlamaForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.31.0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Llama 2B Hf 32768 Fpf

Best Alternatives
Context / RAM
Downloads
Likes
YuLan Mini28K / 4.8 GB88935
...icpm 2B Sft Bf16 Llamafied 16K16K / 6 GB5601
Salamandra 2B8K / 4.5 GB1078922
SmolLM2 MedIT Upscale 2B8K / 4.2 GB314
Salamandra 2B Instruct8K / 4.5 GB414519
Sarvam 2B V0.58K / 5.1 GB70084
Test Quantized8K / 5.8 GB810
EPFL TA Meister Quantized V18K / 5.8 GB830
Llama3 Rommie8K / 5.8 GB820
Llama3 2B Base8K / 4.7 GB651
Note: green Score (e.g. "73.2") means that the model is better than mesolitica/llama-2b-hf-32768-fpf.

Rank the Llama 2B Hf 32768 Fpf Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43187 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227