Fbopt 350M 8bit by yec019

 ยป  All LLMs  ยป  yec019  ยป  Fbopt 350M 8bit   URL Share it on

  8-bit   8bit   Autotrain compatible   Bitsandbytes   Endpoints compatible   Opt   Quantized   Region:us   Safetensors
Model Card on HF ๐Ÿค—: https://huggingface.co/yec019/fbopt-350m-8bit 

Fbopt 350M 8bit Benchmarks

Fbopt 350M 8bit (yec019/fbopt-350m-8bit)

Fbopt 350M 8bit Parameters and Internals

Additional Notes 
This model is for testing the effect of quantization, specifically with 8-bit quantization by bitsandbytes. Part of the UCSD 23Fall 240D course project.
LLM NameFbopt 350M 8bit
Repository ๐Ÿค—https://huggingface.co/yec019/fbopt-350m-8bit 
Model Size350m
Required VRAM0.4 GB
Updated2025-02-15
Maintaineryec019
Model Typeopt
Model Files  0.4 GB
Quantization Type8bit
Model ArchitectureOPTForCausalLM
Licenseunknown
Context Length2048
Model Max Length2048
Transformers Version4.36.0.dev0
Tokenizer ClassGPT2Tokenizer
Padding Token<pad>
Vocabulary Size50272
Torch Data Typefloat16
Activation Functionrelu
Errorsreplace

Best Alternatives to Fbopt 350M 8bit

Best Alternatives
Context / RAM
Downloads
Likes
Ov Opt 350M 8bit Kv Cache2K / 0.4 GB1091
Opt Mini Dataset 02K / 0.7 GB1330
Facebook Opt 350M SFT Korz142K / 0.7 GB1410
Temp Model Sft2K / 1.3 GB1610
Gpt350 Chat S V0 12K / 0.7 GB1820
Gpt350 Chat S V02K / 0.7 GB1300
Dadjokes Tuned Opt2K / 1.3 GB1202
Opt 350M2K / 0.7 GB1033795134
Aira OPT 350M2K / 0 GB2130
Sunday2K / 1.3 GB130

Rank the Fbopt 350M 8bit Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43186 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227