Llama 1B V0 by 1x-technologies

 ยป  All LLMs  ยป  1x-technologies  ยป  Llama 1B V0   URL Share it on

  Autotrain compatible Dataset:1x-technologies/worldm...   Endpoints compatible   Llama   Region:us   Safetensors

Llama 1B V0 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Llama 1B V0 (1x-technologies/Llama_1B_v0)

Llama 1B V0 Parameters and Internals

Model Type 
text generation
Additional Notes 
The model is specifically tailored for the 1X World Model Challenge version v0.0.1 and is not compatible with later versions due to tokenizer differences.
Release Notes 
Version:
v0.0.1
Notes:
Llama3-style LLM baseline for the 1X World Model Challenge. Not compatible with v1.0 or later of the dataset due to a different tokenizer.
LLM NameLlama 1B V0
Repository ๐Ÿค—https://huggingface.co/1x-technologies/Llama_1B_v0 
Model Size1b
Required VRAM2.4 GB
Updated2025-02-22
Maintainer1x-technologies
Model Typellama
Model Files  2.4 GB
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Transformers Version4.41.0
Vocabulary Size1000
Torch Data Typebfloat16

Best Alternatives to Llama 1B V0

Best Alternatives
Context / RAM
Downloads
Likes
LWM Text Chat 1M1024K / 13.5 GB2084175
LWM Text 1M1024K / 13.5 GB49128
JOSIE 1M Base1024K / 13.5 GB121
JOSIE 1M Base1024K / 13.5 GB61
Llama 3.2 1B128K / 2.5 GB108502871584
Llama 3.2 1B Instruct128K / 2.5 GB1716586773
Llama 3.2 1B Instruct128K / 2.5 GB11271463
MiniThinky V2 1B Llama 3.2128K / 4.9 GB729438
Lancer 1 1B Instruct128K / 2.5 GB1102
Llama Express.1 Math128K / 2.5 GB4057
Note: green Score (e.g. "73.2") means that the model is better than 1x-technologies/Llama_1B_v0.

Rank the Llama 1B V0 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 43470 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241227