Llama 2 7B Chat Hf 1bitgs8 Hqq by mobiuslabsgmbh

 ยป  All LLMs  ยป  mobiuslabsgmbh  ยป  Llama 2 7B Chat Hf 1bitgs8 Hqq   URL Share it on

  Arxiv:2402.17764   Autotrain compatible   Conversational   Llama   Region:us

Llama 2 7B Chat Hf 1bitgs8 Hqq Parameters and Internals

LLM NameLlama 2 7B Chat Hf 1bitgs8 Hqq
RepositoryOpen on ๐Ÿค— 
Model Size7b
Required VRAM3 GB
Updated2024-07-26
Maintainermobiuslabsgmbh
Model Typellama
Model Files  3.0 GB
Model ArchitectureLlamaForCausalLM
Licensellama2
Context Length4096
Model Max Length4096
Transformers Version4.39.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat16
Llama 2 7B Chat Hf 1bitgs8 Hqq (mobiuslabsgmbh/Llama-2-7b-chat-hf_1bitgs8_hqq)

Best Alternatives to Llama 2 7B Chat Hf 1bitgs8 Hqq

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
...1M 1000000ctx AEZAKMI 3 1 17020.21024K / 13.5 GB2961
Yarn Llama 2 7B 128K0.2128K / 13.5 GB1274638
LLaMA 7B PoSE YaRN 128K0.2128K / 13.5 GB282
LLaMA 7B PoSE YaRN 96K0.296K / 13.5 GB111
LLaMA 7B PoSE Linear 96K0.296K / 27 GB111
Chat Llama2 7B 80K0.280K / 13.8 GB110
Llama2 7B 80K0.280K / 13.8 GB70
Lloma Step4000.364K / 13.5 GB3060
Lloma Step2000.364K / 13.5 GB2980
Lloma Step500.264K / 13.5 GB2970
Note: green Score (e.g. "73.2") means that the model is better than mobiuslabsgmbh/Llama-2-7b-chat-hf_1bitgs8_hqq.

Rank the Llama 2 7B Chat Hf 1bitgs8 Hqq Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 34446 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072501