Loading…
ExtremeBERT is a toolkit that accelerates the pretraining and finetuning of BERT models on customized datasets. It offers features such as simple installation, fast training with time-based scheduling and mixed precision, a dataset zoo with support for custom data, and integration of custom optimizers and schedulers.
AI named EXTREME-BERT in February 2026.