LLM Name | Cassandra 2.8B |
Repository ๐ค | https://huggingface.co/wbrown/cassandra-2.8b |
Model Size | 2.8b |
Required VRAM | 1.7 GB |
Updated | 2025-02-22 |
Maintainer | wbrown |
Model Type | gpt_neox |
Model Files | |
GGML Quantization | Yes |
Quantization Type | ggml|q4 |
Model Architecture | GPTNeoXForCausalLM |
License | apache-2.0 |
Context Length | 4096 |
Model Max Length | 4096 |
Transformers Version | 4.27.2 |
Vocabulary Size | 50277 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...Int3 Step107000 GPTQ Wikitext2 | 2K / 1.5 GB | 76 | 0 |
...Int4 Step143000 GPTQ Wikitext2 | 2K / 1.8 GB | 79 | 0 |
... Int3 Step71000 GPTQ Wikitext2 | 2K / 1.5 GB | 78 | 0 |
...Int3 Step110000 GPTQ Wikitext2 | 2K / 1.5 GB | 78 | 0 |
...Int4 Step110000 GPTQ Wikitext2 | 2K / 1.8 GB | 78 | 0 |
... Int4 Step71000 GPTQ Wikitext2 | 2K / 1.8 GB | 78 | 0 |
...Int3 Step143000 GPTQ Wikitext2 | 2K / 1.5 GB | 77 | 0 |
Hh Full | 2K / 11.1 GB | 12 | 0 |
... Llm Pythia 2.8B Pm Gen Ian Nd | 2K / 11.1 GB | 5 | 0 |
Pythia 2.8B Sft Hh Rlhf | 2K / 5.6 GB | 132 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐