LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Modello Italia 9B Autoround W4g128 Cpu by fbaldassarri

 »  All LLMs  »  fbaldassarri  »  Modello Italia 9B Autoround W4g128 Cpu   URL Share it on

  84   
  Arxiv:2309.05516   4-bit   Autotrain compatible   Conversational   Endpoints compatible   Gpt neox   Gptq   It   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/fbaldassarri/modello-italia-9b-autoround-w4g128-cpu 

Modello Italia 9B Autoround W4g128 Cpu Benchmarks

LLME Score: 0.19763
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Modello Italia 9B Autoround W4g128 Cpu (fbaldassarri/modello-italia-9b-autoround-w4g128-cpu)

Modello Italia 9B Autoround W4g128 Cpu Parameters and Internals

Model Type 
Large Language Model
Use Cases 
Areas:
Research, Commercial Applications
Primary Use Cases:
General language tasks in Italian
Limitations:
Potentially biased content, Not thoroughly tested for every situation
Additional Notes 
The model was converted and optimized for CPU inference using INT4 quantization and group-size 128. Based on GPT-NeoX architecture.
Supported Languages 
it (Italian)
Safety Evaluation 
Risk Categories:
Bias
Ethical Considerations:
The model recognizes the potential for bias and problematic content inherent in large language models, reflecting imbalances in the training data.
Responsible Ai Considerations 
Fairness:
Modello Italia is intended for a diverse range of use cases, aiming to be accessible without bias. However, users should conduct their safety and adaptation testing.
Mitigation Strategies:
Users are encouraged to perform specific safety and adaptation tests for their applications.
LLM NameModello Italia 9B Autoround W4g128 Cpu
Repository 🤗https://huggingface.co/fbaldassarri/modello-italia-9b-autoround-w4g128-cpu 
Model Size9b
Required VRAM5.2 GB
Updated2025-02-22
Maintainerfbaldassarri
Model Typegpt_neox
Model Files  4.7 GB: 1-of-2   0.5 GB: 2-of-2
Supported Languagesit
Model ArchitectureGPTNeoXForCausalLM
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.41.0
Tokenizer ClassLlamaTokenizer
Vocabulary Size50176
Torch Data Typefloat16

Best Alternatives to Modello Italia 9B Autoround W4g128 Cpu

Best Alternatives
Context / RAM
Downloads
Likes
Modello Italia 9B4K / 34 GB281919
Modello Italia 9B Bf164K / 17.1 GB280110
...Italia 9B Autoround W4g128 Gpu4K / 5.2 GB780
Modello Italia 9B Hf4K / 17.1 GB422
H2ogpt Oig Oasst1 512 6 9b2K / 13.8 GB223118
H2ogpt Oig Oasst1 256 6 9b2K / 13.8 GB19945
Hi NOLIN 9B2K / 19.5 GB736
Archangel Sft Pythia6 9B2K / 13.8 GB430
Note: green Score (e.g. "73.2") means that the model is better than fbaldassarri/modello-italia-9b-autoround-w4g128-cpu.

Rank the Modello Italia 9B Autoround W4g128 Cpu Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227
  Support LLM Explorer