Enhancing Sentiment Classification on Small Datasets through Data Augmentation and Transfer Learning

enhancing-sentiment-classification-on-small-datasets-through-data-augmentation-and-transfer-learning

Enhancing Sentiment Classification on Small Datasets through Data Augmentation and Transfer Learning

[Submitted on 30 Oct 2026]

View PDF HTML (experimental)

Abstract:Small-scale sentiment classification often suffers from data scarcity, which limits the generalization ability of the models. This study evaluates and compares the effectiveness of three data augmentation strategies: Easy Data Augmentation (EDA), back-translation, and contextual token substitution (nlpaug-style), with both traditional machine learning classifiers (Logistic Regression, Random Forest) and transformer-based models (BERT). We perform a comprehensive empirical comparison with low-resource sentiment datasets by summarizing the results of recent studies and performing targeted head-to-head experiments. Our findings indicate that all augmentation methods improve performance. Contextual augmentation yields the most consistent gains for BERT models, while EDA and back-translation provide greater benefits for traditional classifiers. These insights help guide the selection of data augmentation techniques tailored to model type and dataset size, filling a critical gap in research on data augmentation for sentiment classification on small datasets.

Submission history

From: Mahmoud S. Mayaleh [view email]
[v1] Fri, 30 Oct 2026 10:08:46 UTC (551 KB)