Data as of Jul 25, 2026 · Based on 2,718,867 AI responses across 9,511 prompts · See how Parse measures this
TinyBERTgithub.comTinyBERT is a compressed version of BERT that is 7.5x smaller and 9.4x faster while maintaining competitive performance on natural language understanding tasks. It achieves this through a novel transformer distillation process applied during both pre-training and task-specific learning stages.
Parse Score
Sources
ar5iv.labs.arxiv.org shapes more of what AI says about TinyBERT than any other source, at 17% of its citations.
arxiv.org · dl.acm.org · facebook.com · linkedin.com
