LLM Name | H2ogpt Oig Oasst1 Falcon 40B |
Repository ๐ค | https://huggingface.co/h2oai/h2ogpt-oig-oasst1-falcon-40b |
Model Size | 40b |
Required VRAM | 82.5 GB |
Updated | 2024-11-09 |
Maintainer | h2oai |
Model Type | RefinedWeb |
Instruction-Based | Yes |
Model Files | |
Supported Languages | en |
Model Architecture | RWForCausalLM |
License | apache-2.0 |
Model Max Length | 2048 |
Transformers Version | 4.30.0.dev0 |
Is Biased | 0 |
Tokenizer Class | PreTrainedTokenizerFast |
Vocabulary Size | 65024 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Falcon 40B Instruct 8bit | 0K / 41.8 GB | 34 | 6 |
Falcon 40B Instruct GPTQ | 0K / 22.5 GB | 87 | 198 |
...alcon 40B Instruct W4 G128 AWQ | 0K / 22.3 GB | 26 | 2 |
Falcon 40B Instruct GPTQ | 0K / 22.5 GB | 14 | 1 |
...truct GPTQ Inference Endpoints | 0K / 22.5 GB | 21 | 2 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐