Bitnet B1 58 Large by 1bitLLM

 ยป  All LLMs  ยป  1bitLLM  ยป  Bitnet B1 58 Large   URL Share it on

  Arxiv:2402.17764   Autotrain compatible   Endpoints compatible   Has space   License:mit   Llama   Region:us   Safetensors

Rank the Bitnet B1 58 Large Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Bitnet B1 58 Large (1bitLLM/bitnet_b1_58-large)

Bitnet B1 58 Large Parameters and Internals

LLM NameBitnet B1 58 Large
RepositoryOpen on ๐Ÿค— 
Model Size728.8m
Required VRAM2.9 GB
Model Typellama
Model Files  2.9 GB
Model ArchitectureBitnetForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.39.0
Tokenizer ClassBitnetTokenizer
Padding Token<pad>
Vocabulary Size32002
Initializer Range0.02
Torch Data Typefloat16

What open-source LLMs or SLMs are you in search of? 35008 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024040901