Llama 2 7B Chat Hf 1bitgs8 Hqq by mobiuslabsgmbh

 ยป  All LLMs  ยป  mobiuslabsgmbh  ยป  Llama 2 7B Chat Hf 1bitgs8 Hqq   URL Share it on

  Arxiv:2402.17764   Autotrain compatible   Conversational   License:llama2   Llama   Region:us

Rank the Llama 2 7B Chat Hf 1bitgs8 Hqq Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Llama 2 7B Chat Hf 1bitgs8 Hqq (mobiuslabsgmbh/Llama-2-7b-chat-hf_1bitgs8_hqq)

Best Alternatives to Llama 2 7B Chat Hf 1bitgs8 Hqq

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
...1M 1000000ctx AEZAKMI 3 1 17021024K / 13.5 GB8261
Yarn Llama 2 7B 128K128K / 13.5 GB375138
LLaMA 7B PoSE YaRN 128K128K / 13.5 GB82
LLaMA 7B PoSE YaRN 96K96K / 13.5 GB11
LLaMA 7B PoSE Linear 96K96K / 27 GB11
Llama2 7B 80K80K / 13.8 GB80
Chat Llama2 7B 80K80K / 13.8 GB50
Yarn Llama 2 7B 64K64K / 13.5 GB76123
LongAlign 7B 64K64K / 13.5 GB423
LongAlign 7B 64K Base64K / 13.5 GB173

Llama 2 7B Chat Hf 1bitgs8 Hqq Parameters and Internals

LLM NameLlama 2 7B Chat Hf 1bitgs8 Hqq
RepositoryOpen on ๐Ÿค— 
Model Size7b
Required VRAM3 GB
Updated2024-07-01
Maintainermobiuslabsgmbh
Model Typellama
Model Files  3 GB
Model ArchitectureLlamaForCausalLM
Licensellama2
Context Length4096
Model Max Length4096
Transformers Version4.39.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Initializer Range0.02
Torch Data Typefloat16

What open-source LLMs or SLMs are you in search of? 34238 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801