Amber AWQ by TheBloke

 ยป  All LLMs  ยป  TheBloke  ยป  Amber AWQ   URL Share it on

  4-bit   Autotrain compatible   Awq   Base model:llm360/amber Base model:quantized:llm360/am...   En   Llama   Quantized   Region:us   Safetensors
Model Card on HF ๐Ÿค—: https://huggingface.co/TheBloke/Amber-AWQ 

Amber AWQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Amber AWQ (TheBloke/Amber-AWQ)

Amber AWQ Parameters and Internals

Model Type 
amber, text-generation
Additional Notes 
Amber is a 7B English language model with LLaMA architecture, aiming for comprehensive and open-sourced LLM development.
Supported Languages 
English (primary)
Training Details 
Data Sources:
Arxiv, Book, C4, Refined-Web, StarCoder, StackExchange, Wikipedia
Data Volume:
1259.13 billion tokens
Context Length:
2048
Model Architecture:
LLaMA-7B architecture
Input Output 
Input Format:
{prompt}
Accepted Modalities:
text
Output Format:
Text-based response according to the input
LLM NameAmber AWQ
Repository ๐Ÿค—https://huggingface.co/TheBloke/Amber-AWQ 
Model NameAmber
Model CreatorLLM360
Base Model(s)  Amber   LLM360/Amber
Model Size1.1b
Required VRAM3.9 GB
Updated2025-02-22
MaintainerTheBloke
Model Typeamber
Model Files  3.9 GB
Supported Languagesen
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Transformers Version4.36.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Amber AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Medicine Chat AWQ4K / 3.9 GB713
Finance Chat AWQ4K / 3.9 GB693
Law Chat AWQ4K / 3.9 GB683
AdaptLLM Finance Chat AWQ4K / 3.9 GB631
Gorilla Openfunctions V1 AWQ4K / 3.9 GB810
TinyLlama 1.1B Chat V1.0 AWQ2K / 0.8 GB780
Tinyllama AWQ Marlin2K / 0.8 GB431
TinyLlama 1.1B Chat V0.3 AWQ2K / 0.8 GB85403
TinyLlama 1.1B Chat V1.0 AWQ2K / 0.8 GB3916
Medicine LLM AWQ2K / 3.9 GB513
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/Amber-AWQ.

Rank the Amber AWQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227