Ensemble Machine Learning Framework for Big Data Analytics

Abstract

Data is growing tremendously. Every domain is becoming data rich and hence, researchers are more excited to use the concept of big data. Every business organization requires business insights. Lately, researchers are extensively embracing machine learning in diverse areas of research like health-care, astronomy, computational biology, finance, etc. The problem is that the big data concepts should be understood well. There is no threshold value that defines the size of big data. Big data Analytics is not only about the size of data but it is an opportunity to get valuable insights from the massive available data. Machine Learning (ML) applies scientific algorithms to the collected data with the goal of creating automated environment for making predictions or important business decisions. Researchers around the globe are working on improving the machine learning algorithms for modeling prediction and analytics problems. No single best machine learning algorithm is present which is applicable for all the possible cases of problems. So, numerous research attempts have been made for improving the performance of machine learning models by developing an ensemble-classifier which is created by combining multiple machine learning models. An ensemble learning serves as a powerful tool in machine learning as it employs multiple classifiers and works on optimizing the performance of base classifiers separately. Although it cannot always guarantees a success, but generally it offers better performance than a single classifier solution. By choosing a developing a special aggregation technique, an ensemble classifier can aid to scrutinize the risk of obtaining poor results from a single classifier system. In this thesis, a modified variant of an ensemble builder, Multi Criteria based TOPSIS Ensemble (MCTOPE) is proposed. In the proposed method, three new modifications are introduced. Firstly, ensemble builder is developed as an automated process.