What AI says about BESSTIE

BESSTIE is a benchmark for sentiment and sarcasm classification across three varieties of English (en-AU, en-IN, en-UK). It builds datasets from Google Place reviews and Reddit comments using location-based and topic-based filtering, with native speakers annotating the sentiment and sarcasm labels. The project fine-tunes nine LLMs and evaluates them on these tasks, highlighting performance differences between the varieties (better results for en-AU and en-UK than en-IN).