LLM Explorer: A Curated Large Language Model Directory and Analytics  // 

Fbopt 350M 8bit by yec019

What open-source LLMs or SLMs are you in search of? 18857 in total.

 ยป  All LLMs  ยป  yec019  ยป  Fbopt 350M 8bit   URL Share it on

  8-bit   8bit   Autotrain compatible   Endpoints compatible   License:unknown   Opt   Quantized   Region:us   Safetensors

Rank the Fbopt 350M 8bit Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Fbopt 350M 8bit (yec019/fbopt-350m-8bit)

Best Alternatives to Fbopt 350M 8bit

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
Ov Opt 350M 8bit Kv Cache2K / 0.4 GB21
Opt 350M2K /  GB70
Pygmalion 350M2K /  GB70
Opt 350M Onnx Js Quantized2K /  GB60
Opt 350M Onnx Js2K /  GB60
Aira OPT 350M2K / 0 GB1520
Opt 350M Gptq 4bit2K / 0.1 GB4050
Opt 350M2K / 0.7 GB122889104
OPT 350M Erebus2K / 0.7 GB264612
Chat Opt 350M Reward Deepspeed2K / 0.7 GB4627

Fbopt 350M 8bit Parameters and Internals

LLM NameFbopt 350M 8bit
RepositoryOpen on ๐Ÿค— 
Model Size350m
Required VRAM0.4 GB
Updated2024-02-28
Maintaineryec019
Model Typeopt
Model Files  0.4 GB
Quantization Type8bit
Model ArchitectureOPTForCausalLM
Licenseunknown
Context Length2048
Model Max Length2048
Transformers Version4.36.0.dev0
Tokenizer ClassGPT2Tokenizer
Padding Token<pad>
Vocabulary Size50272
Torch Data Typefloat16
Activation Functionrelu
Errorsreplace
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024022003