Optimization of real-time wireless sensor based big data with deep autoencoder network: a tourism sector application with distributed computing

Authors: BEKİR AKSOY, UTKU KOSE

Abstract: Internet usage has increased rapidly with the development of information communication technologies. The increase in internet usage led to the growth of data volumes on the internet and the emergence of the big data concept. Therefore, it has become even more important to analyze the data and make it meaningful. In this study, 690 million queries and approximately 5.9 quadrillion data collected daily from different servers were recorded on the Redis servers by using real-time big data analysis method and load balance structure for a company operating in the tourism sector. Here, wireless networks were used as a triggering factor to gather data from visitors of the hotels and the analysis was supportedwithanoptimizationapproachthroughthedeepautoencodernetwork. Accordingtothedatadensitygathered from the structure developed with distributed computing and the API software in C# language, server group numbers were increased to list the most affordable hotel in the desired times. Thanks to the developed architecture and software, response times of the servers were significantly reduced. In detail, it was seen that the HAProxy responded 11 times faster than NetScaler as the new architecture responded 1160 times faster than the old one. Also, the HashSet system in the newly developed architecture responded 18 times faster than the List system and as general, the new architecture was found to be 9 times faster than the old architecture.

Keywords: Big data, Redis, wireless sensors, autoencoder, distributed computing, tourism

Full Text: PDF