Tess M V1.3 AWQ by TheBloke

 ยป  All LLMs  ยป  TheBloke  ยป  Tess M V1.3 AWQ   URL Share it on

  4-bit   Autotrain compatible   Awq Base model:migtissera/tess-m-v... Base model:quantized:migtisser...   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Tess M V1.3 AWQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Tess M V1.3 AWQ (TheBloke/Tess-M-v1.3-AWQ)

Tess M V1.3 AWQ Parameters and Internals

Model Type 
llama
Additional Notes 
The model has been tested on context lengths up to 16K. It produced slight repetition around 16K context length. It is recommended to test the model according to your use case and limit the context length.
Input Output 
Input Format:
SYSTEM: {system_message} USER: {prompt} ASSISTANT:
Release Notes 
Version:
1.3
Notes:
This version is the stable release. The issues that were present in versions 1.0, 1.1 and 1.2 all have been rectified. Thank you for your patience while R&D was conducted.
LLM NameTess M V1.3 AWQ
Repository ๐Ÿค—https://huggingface.co/TheBloke/Tess-M-v1.3-AWQ 
Model NameTess M v1.3
Model CreatorMigel Tissera
Base Model(s)  migtissera/Tess-M-v1.3   migtissera/Tess-M-v1.3
Model Size5.4b
Required VRAM19.3 GB
Updated2025-02-22
MaintainerTheBloke
Model Typellama
Model Files  10.0 GB: 1-of-2   9.3 GB: 2-of-2
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length200000
Model Max Length200000
Transformers Version4.35.2
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size64002
Torch Data Typefloat16

Best Alternatives to Tess M V1.3 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Pallas 0.5 LASER 0.6 AWQ195K / 19.3 GB111
Pallas 0.5 AWQ195K / 19.3 GB81
Pallas 0.3 AWQ195K / 19.3 GB111
Pallas 0.4 AWQ195K / 19.3 GB101
Tess M V1.2 AWQ195K / 19.3 GB81
Tess M V1.1 AWQ195K / 19.3 GB61
Tess M Creative V1.0 AWQ195K / 19.3 GB151
PiVoT SUS RP AWQ8K / 19.3 GB61
UNA 34Beagles 32K Bf16 V1 GPTQ32K / 19.2 GB383
Memepp Llama 512v 6l 8h 256e2K / 0 GB1760
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/Tess-M-v1.3-AWQ.

Rank the Tess M V1.3 AWQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43508 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227