Marco O1 GGUF by prithivMLmods

 ยป  All LLMs  ยป  prithivMLmods  ยป  Marco O1 GGUF   URL Share it on

  8-bit   Base model:aidc-ai/marco-o1 Base model:quantized:aidc-ai/m...   Conversational   Cot   En   Endpoints compatible   F16   Fp16   Gguf   Llama-cpp   Lrm   Marco-o1   Mcts   Monte carlo tree search   Multilingual   Nlu   Q2   Quantized   Qwen2   Region:us   Tree-algorithm

Marco O1 GGUF Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Marco O1 GGUF (prithivMLmods/Marco-o1-GGUF)

Marco O1 GGUF Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
academic assistance, creative ideation, coding and debugging, discussion and debate
Additional Notes 
Designed to excel in structured disciplines like mathematics, physics, and coding, and in open-ended problems requiring creativity and reasoning.
Supported Languages 
en (Proficient)
LLM NameMarco O1 GGUF
Repository ๐Ÿค—https://huggingface.co/prithivMLmods/Marco-o1-GGUF 
Base Model(s)  Marco O1   AIDC-AI/Marco-o1
Required VRAM3 GB
Updated2024-12-06
MaintainerprithivMLmods
Model Typeqwen2
Model Files  15.2 GB   3.0 GB   4.1 GB   3.8 GB   3.5 GB   4.4 GB   4.7 GB   4.5 GB   5.3 GB   5.4 GB   5.3 GB   6.2 GB   8.1 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typefp16|gguf|q2|q4_k|q5_k
Model ArchitectureAutoModel
Licensecreativeml-openrail-m

Best Alternatives to Marco O1 GGUF

Best Alternatives
Context / RAM
Downloads
Likes
ComicBot V.2 Gguf32K / 5 GB160
...ixtral 8x7B Instruct V0.1 GGUF0K / 15.6 GB58514605
Mixtral 8x7B V0.1 GGUF0K / 15.6 GB5679423
Dolphin 2.5 Mixtral 8x7b GGUF0K / 15.6 GB7663297
Dolphin 2.7 Mixtral 8x7b GGUF0K / 15.6 GB12646134
Futfut By Zephyr7b Gguf0K / 5.1 GB5472
GOAT Llama3.1 V0.10K / 0.2 GB213
Phi 3 Mini 4K Instruct GGUF0K / 1.4 GB168116
...lama Bnb 4bit Clva Q4 K M Gguf0K / 0.7 GB3240
Faust GGUF0K / 2.7 GB10520

Rank the Marco O1 GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 38920 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124