Sqlcoder 7B 2 by defog

 ยป  All LLMs  ยป  defog  ยป  Sqlcoder 7B 2   URL Share it on

  Autotrain compatible   Endpoints compatible   Gguf   Instruct   Llama   Q5   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Sqlcoder 7B 2 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Sqlcoder 7B 2 Parameters and Internals

LLM NameSqlcoder 7B 2
Repository ๐Ÿค—https://huggingface.co/defog/sqlcoder-7b-2 
Base Model(s)  Sqlcoder 7B 2 MLX   ucalyptus/sqlcoder-7b-2-MLX
Model Size7b
Required VRAM13.5 GB
Updated2024-10-18
Maintainerdefog
Model Typellama
Instruction-BasedYes
Model Files  4.9 GB: 1-of-3   5.0 GB: 2-of-3   3.6 GB: 3-of-3   4.8 GB   0.0 GB
GGUF QuantizationYes
Quantization Typeq5|gguf|q5_k
Model ArchitectureLlamaForCausalLM
Licensecc-by-sa-4.0
Context Length16384
Model Max Length16384
Transformers Version4.37.2
Tokenizer ClassCodeLlamaTokenizer
Vocabulary Size32016
Torch Data Typefloat16
Sqlcoder 7B 2 (defog/sqlcoder-7b-2)

Quantized Models of the Sqlcoder 7B 2

Model
Likes
Downloads
VRAM
Sqlcoder 7B 2 GGUF83052 GB

Best Alternatives to Sqlcoder 7B 2

Best Alternatives
Context / RAM
Downloads
Likes
Sql Code Gguf16K / 4.8 GB90
...pseek Coder 6.7B Instruct GGUF16K / 2.5 GB6716
Bailong Orpo 7B4K / 14 GB345
Latxa 7B Instruct4K / 13.5 GB300
...lumiX 32K Instruct Q4 K M GGUF32K / 4.1 GB194
...p 0.05 Max Grad1.0 Grad Accu3232K / 14.4 GB60
...p 0.05 Max Grad1.0 Grad Accu3232K / 14.4 GB50
...ruct Solidity Bnb 4bit Smashed16K / 4.2 GB50
...B Instruct Hf Bnb 4bit Smashed16K / 4.2 GB250
CodelLama7B Inst DPO 7K Mlx16K / 4.2 GB62

Rank the Sqlcoder 7B 2 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 36966 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v2024072803