LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

NousResearch Genstruct 7B GGUF by Isaak-Carter

 »  All LLMs  »  Isaak-Carter  »  NousResearch Genstruct 7B GGUF   URL Share it on

  152   
  Arxiv:2310.04484   Autotrain compatible Base model:mistralai/mistral-7...   Conversational   En   Endpoints compatible   Finetuned   Gguf   Instruct   License:apache-2.0   Mistral   Quantized   Region:us   Safetensors   Sharded   Synthetic   Tensorflow

NousResearch Genstruct 7B GGUF Benchmarks

HF Avg Score: 60.1  vs  86.1  (GPT-4) -30.2%
ARC: 73.6-23.6%
HellaSwag: 66.3-30.4%
MMLU: 56.4-34.8%
GSM8K: 34.2-62.8%
OpenCompass Avg: 53.6  vs  73.3  (GPT-4) -26.9%
Exam: 63.7-17.5%
Language: 41.9-32.4%
Knowledge: 58.1-21%
Understanding: 62.3-11%
Reasoning: 49.8-33.1%
nn.n% — How the model compares to the GPT-4.

Rank the NousResearch Genstruct 7B GGUF Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
NousResearch Genstruct 7B GGUF (Isaak-Carter/NousResearch-Genstruct-7B-GGUF)

Best Alternatives to NousResearch Genstruct 7B GGUF

Best Alternatives
HF Rank
Context/RAM
Downloads
Likes
KAI 7B V0.174.4532K / 14.4 GB1410
Dolphin 2.2.1 Mistral 7B73.1732K / 14.4 GB8003188
Mistral 7B V0.168.5332K / 14.4 GB7103103291
...andle Dolphin 2.2.1 Mistral 7B64.232K / 14.4 GB2650
....1 Mistral 7B Bnb 4bit Smashed64.232K / 4.5 GB140
....1 Mistral 7B AWQ 4bit Smashed64.232K / 4.2 GB80
Mistral 7B Instruct V0.162.2332K / 14.4 GB4013861465
Notus 7B V160.1532K / 14.4 GB3474118
OpenhermesTrial60.132K / 14.4 GB250
...t 3.5 0106 128K 4.0bpw H6 EXL260.1128K / 3.9 GB01
Note: green Score (e.g. "73.2") means that the model is better than Isaak-Carter/NousResearch-Genstruct-7B-GGUF.

NousResearch Genstruct 7B GGUF Parameters and Internals

LLM NameNousResearch Genstruct 7B GGUF
RepositoryOpen on 🤗 
Base Model(s)  Mistral 7B V0.1   mistralai/Mistral-7B-v0.1
Model Size7b
Required VRAM14.4 GB
Updated2024-07-05
MaintainerIsaak-Carter
Model Typemistral
Model Files  3.8 GB   3.5 GB   3.2 GB   4.4 GB   4.1 GB   5.0 GB   5.1 GB   5.0 GB   5.9 GB   7.7 GB   14.5 GB   4.9 GB: 1-of-3   5.0 GB: 2-of-3   4.5 GB: 3-of-3
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.36.2
Tokenizer ClassLlamaTokenizer
Padding Token[PAD]
Vocabulary Size32001
Initializer Range0.02
Torch Data Typebfloat16

What open-source LLMs or SLMs are you in search of? 34431 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024042801
  Support LLM Explorer