Arxiv:1910.09700 Adapter Base model:adapter:tiiuae/falc... Base model:tiiuae/falcon-rw-1b Custom code Falcon Finetuned Lora Peft Pytorch Region:us Safetensors
Model Card on HF 🤗: https://huggingface.co/GouthamVignesh/falcon-arxiv-long-summary-1B
Falcon Arxiv Long Summary 1B Benchmarks
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
What is the LLM Explorer Rank (Score)
Falcon Arxiv Long Summary 1B Parameters and Internals
| Training Details |
|
| LLM Name | Falcon Arxiv Long Summary 1B |
| Repository 🤗 | https://huggingface.co/GouthamVignesh/falcon-arxiv-long-summary-1B |
| Base Model(s) | |
| Model Size | 1b |
| Required VRAM | 0.2 GB |
| Updated | 2025-02-05 |
| Maintainer | GouthamVignesh |
| Model Files | |
| Model Architecture | Adapter |
| Model Max Length | 1024 |
| Is Biased | none |
| Tokenizer Class | GPT2Tokenizer |
| Padding Token | <|endoftext|> |
| PEFT Type | LORA |
| LoRA Model | Yes |
| PEFT Target Modules | query_key_value|dense_4h_to_h|dense_h_to_4h|dense |
| LoRA Alpha | 16 |
| LoRA Dropout | 0.1 |
| R Param | 64 |
Best Alternatives to Falcon Arxiv Long Summary 1B
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| ...iabolic6045 ELN AOC CAIN QLoRA | 0K / 0 GB | 19 | 0 |
| Openhermes 1B Olmo Sft Qlora | 0K / 0 GB | 5 | 0 |
| Zephyr 1B Olmo Sft Qlora | 0K / 0 GB | 3 | 1 |
| Peft Starcoder Lora Python | 0K / 0 GB | 5 | 0 |
| Prem 1B Chat 32K | 0K / 1.4 GB | 8 | 1 |
| Prem 1B 32K | 0K / 1.4 GB | 6 | 1 |
| ...ama 3 1M Context Gradient Lora | 0K / 3.5 GB | 0 | 12 |
| ...lcon 1B HomemadePromptImprover | 0K / 0 GB | 0 | 1 |
| Deci Decicoder 1B Lora Coder | 0K / 0 GB | 6 | 1 |
| Falcon 1B Odia Lora Pt | 0K / 0.9 GB | 5 | 0 |
Note: green Score (e.g. "73.2") means that the model is better than GouthamVignesh/falcon-arxiv-long-summary-1B .
Rank the Falcon Arxiv Long Summary 1B Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 42577 in total.
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227