Llama 7B Onnx Merged Fp32 by nenkoru

 ยป  All LLMs  ยป  nenkoru  ยป  Llama 7B Onnx Merged Fp32   URL Share it on

  Merged Model   Autotrain compatible   Endpoints compatible   Llama   Onnx   Region:us

Llama 7B Onnx Merged Fp32 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Llama 7B Onnx Merged Fp32 (nenkoru/llama-7b-onnx-merged-fp32)

Llama 7B Onnx Merged Fp32 Parameters and Internals

Model Type 
auto-regressive language model, transformer architecture
Use Cases 
Areas:
research on large language models
Applications:
question answering, natural language understanding, reading comprehension
Primary Use Cases:
understanding capabilities and limitations of current language models, developing improvement techniques
Limitations:
not intended for downstream applications without risk evaluation
Considerations:
Model can produce harmful content or incorrect information.
Supported Languages 
en (>20 languages including English, but primarily trained on English)
Training Details 
Data Sources:
CCNet (67%), C4 (15%), GitHub (4.5%), Wikipedia (4.5%), Books (4.5%), ArXiv (2.5%), Stack Exchange (2%)
Responsible Ai Considerations 
Fairness:
The model might exhibit biases related to gender, religion, race, sexual orientation, age, nationality, disability, and physical appearance, reflecting biases from the training data.
Transparency:
The model's performance and evaluation metrics are detailed in published resources.
Accountability:
Meta AI's FAIR team is responsible for the model's outputs.
Mitigation Strategies:
Data filtering was performed using a Kneser-Ney language model and a fastText linear classifier to remove offensive content.
Release Notes 
Version:
1
Date:
2023-02-28
Notes:
Initial release of the model.
LLM NameLlama 7B Onnx Merged Fp32
Repository ๐Ÿค—https://huggingface.co/nenkoru/llama-7b-onnx-merged-fp32 
Merged ModelYes
Model Size7b
Updated2025-02-05
Maintainernenkoru
Model Typellama
Model ArchitectureLLaMAForCausalLM
Licenseother
Context Length2048
Model Max Length2048
Transformers Version4.28.0.dev0
Vocabulary Size32000

Quantized Models of the Llama 7B Onnx Merged Fp32

Model
Likes
Downloads
VRAM
Llama 7B Onnx Merged Fp16770 GB

Best Alternatives to Llama 7B Onnx Merged Fp32

Best Alternatives
Context / RAM
Downloads
Likes
Honest Llama2 Chat 7B2K / 13.5 GB819
Chatdoctor0K / 27 GB123211
...xplore LM Ext 7B Brainstorming0K / 27 GB112
Explore LM Ext 7B Rewriting0K / 27 GB101
Explore LM 7B Brainstorming0K / 27 GB120
Explore LM Ext 7B Math0K / 27 GB100
Explore LM 7B Math0K / 27 GB71
Explore LM 7B Rewriting0K / 27 GB70
Alpaca7B Lora Zh Tiny20K / 7 GB811
ChatDoctor Change0K / 27 GB81
Note: green Score (e.g. "73.2") means that the model is better than nenkoru/llama-7b-onnx-merged-fp32.

Rank the Llama 7B Onnx Merged Fp32 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 42577 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227