Fusion: Practice and Applications FPA 2692-4048 2770-0070 10.54216/FPA https://www.americaspg.com/journals/show/1458 2018 2018 Benchmarking Machine Learning for Sentimental Analysis of Climate Change Tweets in Social Internet of Things Department of Entrepreneurship and Logistics, Plekhanov Russian University of Economics, 117997, Moscow, Russia Irina V. Pustokhina Department of Logistics, State University of Management, 109542, Moscow, Russia Denis A. Pustokhin Climate change has become one of the most critical problems threatening our world, gaining increased attention in either academia or industry. Climate change has been demonstrated as the major barrier in the way of sustainable development strategy in the 2030 Agenda. Nowadays, the Social Internet of Things (SIoT) has paved new ways for public deliberations and has transformed the communication of global issues such as climate change. Thus, sentiment analysis of SIoT media streams can offer great help in improving the mitigation and adaptation to climate change. Machine learning (ML) is demonstrating great success in a wide range of SIoT applications. However, training ML algorithms for sentimental analysis of climate change is notoriously hard as it suffers from feature engineering issues, information squashing, unbalancing, and curse-of-dimensionality, which bounds their possible power for modeling social awareness of climate change. Besides, the absence of a standard benchmark with reasonable and dependable experimentations brings a practically intractable difficulty to the evaluation of the efficiency of new solutions. In this regard, this study introduces the first reasonable and reproducible benchmark devoted to evaluating the potential of ML algorithms in identifying users’ opinions about climate change. Moreover, a novel taxonomy is presented for categorizing the existing ML algorithms, exploring their optimal hyperparameter, and unifying their elementary settings. Inclusive experiments are then performed on real Twitter data with different families of ML algorithms. To promote further study, a detailed analysis is provided for the state of the field to uncover the open research challenges and promising future directions. 2023 2023 20 33 10.54216/FPA.100102 https://www.americaspg.com/articleinfo/3/show/1458