LLM Explorer: A Curated Large Language Model Directory and Analytics  // 

Medguanaco 65B GPTQ by nmitchko

What open-source LLMs or SLMs are you in search of? 18857 in total.

 ยป  All LLMs  ยป  nmitchko  ยป  Medguanaco 65B GPTQ   URL Share it on

  Arxiv:2106.09685   Arxiv:2303.14070   Autotrain compatible   En   Endpoints compatible   Gptq   Has space   License:cc   Llama   Medical   Pytorch   Quantized   Region:us   Sharded

Rank the Medguanaco 65B GPTQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  
Medguanaco 65B GPTQ (nmitchko/medguanaco-65b-GPTQ)

Best Alternatives to Medguanaco 65B GPTQ

Best Alternatives
HF Rank
Llama 65B Instruct64.512K / 130.4 GB163110
Openbuddy Llama 65B V8 Bf1664.472K / 130.6 GB26259
UltraLM 65B63.822K / 130.4 GB10137
Gpt4 Alpaca Lora Mlp 65B HF63.662K / 130.4 GB23397
Llama 65B62.790K / 130.4 GB407268
Guanaco 65B HF62.672K / 130.4 GB236227
...Unlocked Alpaca 65B QLoRA Fp1662.582K / 130.4 GB244610
Airoboros 65B Gpt4 1.262.362K / 130.4 GB176921
Alpaca Elina 65B62.032K / 130.4 GB27533
Robin 65B V2 Fp1661.482K / 130.4 GB23653
Note: green Score (e.g. "73.2") means that the model is better than nmitchko/medguanaco-65b-GPTQ.

Medguanaco 65B GPTQ Parameters and Internals

LLM NameMedguanaco 65B GPTQ
RepositoryOpen on ๐Ÿค— 
Model Size65b
Required VRAM33.8 GB
Model Typellama
Model Files  10.0 GB: 1-of-4   9.9 GB: 2-of-4   9.9 GB: 3-of-4   4.0 GB: 4-of-4
Supported Languagesen
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.29.2
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Initializer Range0.02
Torch Data Typefloat16
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024022003