smollm

434.1K 1 year ago

馃獝 A family of small models with 135M, 360M, and 1.7B parameters, trained on a new high-quality dataset.

135m 360m 1.7b

Models

View all →

94 models

smollm:latest

991MB 路 2K context window 路 Text 路 1 year ago

smollm:135m

92MB 路 2K context window 路 Text 路 1 year ago

smollm:360m

229MB 路 2K context window 路 Text 路 1 year ago

smollm:1.7b

latest

991MB 路 2K context window 路 Text 路 1 year ago

Readme

SmolLM is a series of small language models available in three sizes: 135M, 360M, and 1.7B parameters.

References

Blog post

Hugging Face