Llama 3 8B Instruct Gradient 1048K GGUF by second-state

 ยป  All LLMs  ยป  second-state  ยป  Llama 3 8B Instruct Gradient 1048K GGUF   URL Share it on

  Autotrain compatible Base model:gradientai/llama-3-...   En   Gguf   Instruct   License:other   Llama   Llama-3   Meta   Q2   Quantized   Region:us

Llama 3 8B Instruct Gradient 1048K GGUF Parameters and Internals

LLM NameLlama 3 8B Instruct Gradient 1048K GGUF
RepositoryOpen on ๐Ÿค— 
Model NameLlama-3-8B-Instruct-Gradient-1048k
Model Creatorgradient.ai
Base Model(s)  ...a 3 8B Instruct Gradient 1048K   gradientai/Llama-3-8B-Instruct-Gradient-1048k
Model Size8b
Required VRAM3.2 GB
Updated2024-07-21
Maintainersecond-state
Model Typellama
Instruction-BasedYes
Model Files  3.2 GB   4.3 GB   4.0 GB   3.7 GB   4.7 GB   4.9 GB   4.7 GB   5.6 GB   5.7 GB   5.6 GB   6.6 GB   8.5 GB   16.1 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|q2|q4_k|q5_k
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length1048576
Model Max Length1048576
Transformers Version4.39.1
Vocabulary Size128256
Torch Data Typebfloat16
Llama 3 8B Instruct Gradient 1048K GGUF (second-state/Llama-3-8B-Instruct-Gradient-1048k-GGUF)

Best Alternatives to Llama 3 8B Instruct Gradient 1048K GGUF

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
...truct Gradient 1048K IMat GGUF0.31024K / 2 GB3646
Llama 3 8B Instruct 262K GGUF0.2256K / 3.2 GB2802
Alpha R S V2 Q8 0 GGUF0.239K / 8.5 GB180
...ama3 8B Chinese Chat GGUF 8bit0.48K / 8.5 GB336647153
CircularConstructionGPT 10.38K / 16.1 GB19180
...ama3 8B Chinese Chat GGUF 4bit0.38K / 4.7 GB361718
...lama3 8B Chinese Chat GGUF F160.38K / 16.1 GB287325
CPE Chatbot0.38K / 16.1 GB5090
...hinese 8B Instruct V3 Accident0.38K / 16.1 GB1481
Llama 3 Chinese 8B Instruct V30.38K / 16.1 GB1111
Note: green Score (e.g. "73.2") means that the model is better than second-state/Llama-3-8B-Instruct-Gradient-1048k-GGUF.

Rank the Llama 3 8B Instruct Gradient 1048K GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 34266 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024071601