Modernbert Articles

Page 1 of 1 (3 articles)

2/10/2025 • EN

Explores using a masked language model's head for zero-shot tasks, achieving strong results without task-specific heads.

Encoder Models Instruction Tuning Masked Language Modeling Modernbert Zero Shot Learning

12/25/2024 • EN

A tutorial on fine-tuning the ModernBERT model for classification tasks to build an efficient LLM router, covering setup, training, and evaluation.

Bert classification Fine Tuning LLM Routing Modernbert

12/19/2024 • EN

Introducing ModernBERT, a new family of state-of-the-art encoder models designed as a faster, more efficient replacement for the widely-used BERT.

Bert Masked Language Model Modernbert NLP Transformers

Select Language