Model Type |
| ||||||||||||
Additional Notes |
| ||||||||||||
Supported Languages |
| ||||||||||||
Training Details |
| ||||||||||||
Input Output |
|
LLM Name | Amber AWQ |
Repository ๐ค | https://huggingface.co/TheBloke/Amber-AWQ |
Model Name | Amber |
Model Creator | LLM360 |
Base Model(s) | |
Model Size | 1.1b |
Required VRAM | 3.9 GB |
Updated | 2025-02-22 |
Maintainer | TheBloke |
Model Type | amber |
Model Files | |
Supported Languages | en |
AWQ Quantization | Yes |
Quantization Type | awq |
Model Architecture | LlamaForCausalLM |
License | apache-2.0 |
Context Length | 2048 |
Model Max Length | 2048 |
Transformers Version | 4.36.0.dev0 |
Tokenizer Class | LlamaTokenizer |
Vocabulary Size | 32000 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Medicine Chat AWQ | 4K / 3.9 GB | 71 | 3 |
Finance Chat AWQ | 4K / 3.9 GB | 69 | 3 |
Law Chat AWQ | 4K / 3.9 GB | 68 | 3 |
AdaptLLM Finance Chat AWQ | 4K / 3.9 GB | 63 | 1 |
Gorilla Openfunctions V1 AWQ | 4K / 3.9 GB | 81 | 0 |
TinyLlama 1.1B Chat V1.0 AWQ | 2K / 0.8 GB | 78 | 0 |
Tinyllama AWQ Marlin | 2K / 0.8 GB | 43 | 1 |
TinyLlama 1.1B Chat V0.3 AWQ | 2K / 0.8 GB | 8540 | 3 |
TinyLlama 1.1B Chat V1.0 AWQ | 2K / 0.8 GB | 391 | 6 |
Medicine LLM AWQ | 2K / 3.9 GB | 51 | 3 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐