LLM Name | Phi 2 Int8 Ov |
Repository ๐ค | https://huggingface.co/OpenVINO/phi-2-int8-ov |
Base Model(s) | |
Required VRAM | 0 GB |
Updated | 2024-10-30 |
Maintainer | OpenVINO |
Model Type | phi |
Model Files | |
Supported Languages | en |
Model Architecture | PhiForCausalLM |
License | mit |
Context Length | 2048 |
Model Max Length | 2048 |
Transformers Version | 4.40.1 |
Tokenizer Class | CodeGenTokenizer |
Vocabulary Size | 51200 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Phi1.5 Quantized 2 | 2K / GB | 12 | 0 |
Merlin1.4 | 2K / 5.6 GB | 79 | 0 |
Merlin1.5 | 2K / 5.6 GB | 77 | 0 |
Merlin1.2 | 2K / 5.6 GB | 77 | 0 |
Merlin1.3 | 2K / 5.6 GB | 74 | 0 |
Tinyllama Quant | 2K / 0.8 GB | 14 | 1 |
Phi1.5 Update 4 | 2K / GB | 16 | 0 |
Phi 2 Fp8 | 2K / 3.3 GB | 7 | 0 |
Phi 2 Ov Quantized | 2K / 1.9 GB | 48 | 0 |
Phi Bode 2 Ultraalpaca | 2K / 5.6 GB | 32 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐