eprintid: 4421 rev_number: 6 eprint_status: archive userid: 408 dir: disk0/00/00/44/21 datestamp: 2021-03-15 04:23:35 lastmod: 2021-03-15 04:23:35 status_changed: 2021-03-15 04:23:35 type: article metadata_visibility: no_search creators_name: Pham, Manh Linh creators_name: Hoang, Xuan Tung creators_id: linhmp@vnu.edu.vn creators_id: tunghx@vnu.edu.vn title: An Elasticity Framework for Distributed MQTT Brokers ispublished: inpress subjects: IT divisions: FIMO divisions: fac_fit keywords: MQTT broker, Elasticity, Internet of Things, Cloud computing abstract: Internet of Things (IoT) applications are increasingly making impact in all areas of human life. Day by day, its chatty embedded devices have been generating tons of data requiring effective network infrastructure. To deliver millions of IoT messages back and fort with as few faults as possible, participation of communication protocols like MQTT is a must. Lightweight blueprint and battery friendly design are just two of many advantages of this protocol making it become a dominant in IoT world. In real application scenarios, distributed MQTT solutions are usually required since centralized MQTT approach is incapable of dealing with huge amount of data. Although distributed MQTT solutions are scalable, they do not adapt to fluctuations of traffic workload. This might cost IoT service providers because of redundant computation resources. This leads to the need of a novel approach that can adapt its volume changes in workload. This article proposes such an elastic solution by proposing a flexible MQTT framework. Our MQTT framework uses off-the-shelf components to obtain server’s elasticity while keeping IoT applications intact. Experiments are conducted to validate elasticity function provided by an implementation of our framework. date: 2021 contact_email: linhmp@vnu.edu.vn full_text_status: public publication: VNU Journal of Science: Computer Science and Communication Engineering refereed: TRUE issn: 2588-1086 referencetext: [1] N. Sharma, D. Panwar, (2020) Green IoT: Advancements and Sustainability with Environment by 2050. In: 8th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO), Noida, India, pp. 1127-1132. [2] V. Turner, D. Reinsel, J.F. Gantz, S. Minton, The Digital Universe of Opportunities: Rich Data and the Increasing Value of the Internet of Things, IDC Report Apr. (2014). [3] MQ Telemetry Transport, ‘http://mqtt.org,” visited on Oct. (2020). [4] P. Mell and T. Grance, The NIST definition of cloud computing (draft), NIST special publication, vol. 800, p. 145, (2011). [5] P. Th. Eugster, P. A. Felber, R. Guerraoui, A. Kermarrec, The many faces of publish/subscribe. ACM Comput. Surv. 35, 2 (June 2003), 114-131. [6] R. Kawaguchi, M. Bandai, Edge Based MQTT Broker Architecture for Geographical IoT Applications, 2020 International Conference on Information Networking (ICOIN), Barcelona, Spain, (2020), pp. 232-235. [7] V. Gupta, S. Khera, N. Turk, MQTT protocol employing IOT based home safety system with ABE encryption, Multimed Tools Appl (2020). [8] Mukambikeshwari, A. Poojary, Smart Watering System Using MQTT Protocol in IoT, Advances in Artificial Intelligence and Data Engineering. Advances in Intelligent Systems and Computing, vol 1133. Springer, Singapore (2020). [9] Y. C. See, E. X. Ho, IoT-Based Fire Safety System Using MQTT Communication Protocol, ijie, vol. 12, no. 6, pp. 207-215, Jul. (2020). [10] S. Nazir, M. Kaleem, Reliable Image Notifications for Smart Home Security with MQTT, International Conference on Information Science and Communication Technology (ICISCT), Karachi, Pakistan, (2019), pp. 1-5. [11] P. Alqinsi, I. J. M. Edward, N. Ismail, W. Darmalaksana, IoT-Based UPS Monitoring System Using MQTT Protocols, 4th International Conference on Wireless and Telematics (ICWT), Nusa Dua, (2018), pp. 1-5. [12] Comparison of MQTT Brokers, ‘https://tewarid.github.io/2019/03/21/comparisonof-mqtt-brokers.html,” visited on Oct. (2020). [13] M. Collina, G. E. Corazza, A. Vanelli-Coralli, Introducing the QEST broker: Scaling the IoT by bridging MQTT and REST, 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications - (PIMRC), Sydney, NSW, (2012), pp. 36-41. [14] A. Schmitt, F. Carlier, V. Renault, Data Exchange with the MQTT Protocol: Dynamic Bridge Approach, 2019 IEEE 89th Vehicular Technology Conference (VTC2019-Spring), Kuala Lumpur, Malaysia, (2019), pp. 1-5. [15] A. M. Zambrano V, M. Zambrano V, E.L.O. Mej´ıa, X. Calderon H, SIGPRO: A Real-Time Progressive ´ Notification System Using MQTT Bridges and Topic Hierarchy for Rapid Location of Missing Persons, in IEEE Access, vol. 8, pp. 149190-149198, 2020. [16] The features that various MQTT servers (brokers) support, ‘https://github.com/mqtt/mqtt.github.io/wiki/serversupport,” visited on Oct. (2020). [17] P. Jutadhamakorn, T. Pillavas, V. Visoottiviseth, R. Takano, J. Haga, D. Kobayashi, A scalable and low-cost MQTT broker clustering system, 2017 2nd International Conference on Information Technology (INCIT), Nakhonpathom, (2017), pp. 1-5. [18] Z. Y. Thean, V. Voon Yap, P. C. Teh, Container-based MQTT Broker Cluster for Edge Computing, 2019 4th International Conference and Workshops on Recent Advances and Innovations in Engineering (ICRAIE), Kedah, Malaysia, (2019), pp. 1-6. [19] A. Detti, L. Funari, N. Blefari-Melazzi, Sub-Linear Scalability of MQTT Clusters in Topic-Based PublishSubscribe Applications, in IEEE Transactions on Network and Service Management, vol. 17, no. 3, pp. 1954-1968, Sept. (2020). [20] R.R. Righi, E, Correa, M.M. Gomes, C.A. Costa, Enhancing performance of IoT applications with load prediction and cloud elasticity, Future Generation Computer Systems, Volume 109, (2020), Pages 689- 701. [21] M. H. Fourati, S. Marzouk, K. Drira and M. Jmaiel, DOCKERANALYZER : Towards Fine Grained Resource Elasticity for MicroservicesBased Applications Deployed with Docker, 20th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT), Gold Coast, Australia, (2019), pp. 220-225. [22] M. Nardelli, V. Cardellini, E. Casalicchio, Multi-Level Elastic Deployment of Containerized Applications in Geo-Distributed Environments, 2018 IEEE 6th International Conference on Future Internet of Things and Cloud (FiCloud), Barcelona, (2018), pp. 1-8, [23] L.M. Pham, A Big Data Analytics Framework for IoT Applications in the Cloud, VNU Journal of Science: Computer Science and Communication Engineering, 31(2):44–55, (2015). [24] V.F. Rodrigues, I.G. Wendt, R.R. Righi, C.A. Costa, J.L.V. Barbosa, A.M. Alberti, Brokel: Towards enabling multi-level cloud elasticity on publish/subscribe brokers, International Journal of Distributed Sensor Networks, vol. 13, no. 8, (2017). [25] S. Vavassori, J. Soriano, R. Fernandez, Enabling ´ Large-Scale IoT-Based Services through Elastic Publish/Subscribe. Sensors (2017), 17, 2148. [26] A distributed, reliable key-value store, ‘https://etcd.io/docs/v3.4.0/,” visited on Oct. (2020). [27] D. Roure, C. Goble, Software Design for Empowering Scientists, IEEE Software, vol. 26, no. 01, pp. 88-95, (2009). [28] EMQX Broker, ‘https://docs.emqx.io/broker/latest/en/,’ visited on Oct. (2020). [29] Kubernetes, ‘https://kubernetes.io/,” visited on Oct. (2020). [30] HAProxy, ‘https://www.haproxy.com/solutions/loadbalancing/,” visited on Oct. (2020). [31] OpenStack: Open Source Cloud Computing Infrastructure, ‘https://www.openstack.org/,” visited on Oct. (2020). [32] OpenStack Heat, ‘https://docs.openstack.org/heat/latest/,” visited on Oct. (2020). [33] OpenStack Ceilometer, ‘ https://docs.openstack.org/ceilometer/latest/,” visited on Oct. (2020). [34] OpenStack Aodh, ‘ https://docs.openstack.org/aodh/latest/,” visited on Oct. (2020). [35] Gnocchi - Metric as a Service, ‘https://gnocchi.xyz/,” visited on Oct. (2020). [36] RabbitMQ, ‘https://www.rabbitmq.com/,” visited on Oct. (2020). [37] Apache Jmeter, ‘ https://jmeter.apache.org/,” visited on Oct. (2020). [38] L.M. Pham, T.T. Nguyen, M.D. Tran, A Benchmarking Tool for Elastic MQTT Brokers in IoT Applications, International Journal of Information and Communication Sciences. Vol. 4, No. 4, (2019), pp. 59-67. funders: VNU University of Engineering and Technology projects: CN19.09 citation: Pham, Manh Linh and Hoang, Xuan Tung (2021) An Elasticity Framework for Distributed MQTT Brokers. VNU Journal of Science: Computer Science and Communication Engineering . ISSN 2588-1086 (In Press) document_url: https://eprints.uet.vnu.edu.vn/eprints/id/eprint/4421/1/JCSCE20_CR_An_Elasticity_Framework_for_Distributed_MQTT_Brokers.pdf