Loading…
BertAttentionViz is a Streamlit-powered web application that visualizes attention weights from BERT-based models (DistillBERT). Users input text, choose layers and heads, and view attention visualizations, with options to exclude special tokens and plot top predictions for masked tokens in multiple formats. The project includes a live Streamlit demo and can be run locally by cloning the repository and running the Streamlit app (streamlit_app.py).
AI named BERT Attention Visualization from December 2025 to February 2026.