LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Modello Italia 9B Autoround W4g128 Gpu by fbaldassarri

 »  All LLMs  »  fbaldassarri  »  Modello Italia 9B Autoround W4g128 Gpu   URL Share it on

  78   
  Arxiv:2309.05516   4-bit   Autotrain compatible   Conversational   Endpoints compatible   Gpt neox   Gptq   It   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/fbaldassarri/modello-italia-9b-autoround-w4g128-gpu 

Modello Italia 9B Autoround W4g128 Gpu Benchmarks

LLME Score: 0.19763
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Modello Italia 9B Autoround W4g128 Gpu (fbaldassarri/modello-italia-9b-autoround-w4g128-gpu)

Modello Italia 9B Autoround W4g128 Gpu Parameters and Internals

Model Type 
Large Language Model
Use Cases 
Areas:
Commercial applications, Research
Limitations:
Possibility of generating inaccurate, biased or other problematic responses
Additional Notes 
The model has been unofficially quantized for optimization using Intel auto-round.
Supported Languages 
Italian (Proficient), English (Unknown)
Training Details 
Methodology:
Quantized in INT4, optimized for GPUs.
Model Architecture:
GPT-NeoX
Responsible Ai Considerations 
Fairness:
The model attempts to be inclusive for a wide range of use-cases without inserting superfluous judgments.
Mitigation Strategies:
Developers are encouraged to run safety tests specific to their applications.
LLM NameModello Italia 9B Autoround W4g128 Gpu
Repository 🤗https://huggingface.co/fbaldassarri/modello-italia-9b-autoround-w4g128-gpu 
Model Size9b
Required VRAM5.2 GB
Updated2025-02-22
Maintainerfbaldassarri
Model Typegpt_neox
Model Files  5.2 GB
Supported Languagesit
Model ArchitectureGPTNeoXForCausalLM
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.41.2
Tokenizer ClassLlamaTokenizer
Vocabulary Size50176
Torch Data Typefloat32

Best Alternatives to Modello Italia 9B Autoround W4g128 Gpu

Best Alternatives
Context / RAM
Downloads
Likes
Modello Italia 9B4K / 34 GB281919
Modello Italia 9B Bf164K / 17.1 GB280110
...Italia 9B Autoround W4g128 Cpu4K / 5.2 GB840
Modello Italia 9B Hf4K / 17.1 GB422
H2ogpt Oig Oasst1 512 6 9b2K / 13.8 GB223118
H2ogpt Oig Oasst1 256 6 9b2K / 13.8 GB19945
Hi NOLIN 9B2K / 19.5 GB736
Archangel Sft Pythia6 9B2K / 13.8 GB430
Note: green Score (e.g. "73.2") means that the model is better than fbaldassarri/modello-italia-9b-autoround-w4g128-gpu.

Rank the Modello Italia 9B Autoround W4g128 Gpu Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer