eprintid: 3588
rev_number: 8
eprint_status: archive
userid: 408
dir: disk0/00/00/35/88
datestamp: 2019-11-27 06:59:08
lastmod: 2019-11-27 06:59:08
status_changed: 2019-11-27 06:59:08
type: article
metadata_visibility: show
creators_name: Pham, Manh Linh
creators_name: Nguyen, Truong Thang
creators_name: Tran, Manh Dong
creators_id: linhmp@vnu.edu.vn
creators_id: ntthang@ioit.ac.vn
creators_id: dongtm@ioit.ac.vn
title: A Benchmarking Tool for Elastic MQTT Brokers in IoT Applications
ispublished: pub
subjects: IT
divisions: FIMO
divisions: fac_fit
keywords: Benchmarking, MQTT, Cloud Computing, Internet of Things
abstract: Cloud computing is an evolution in IT consumption and delivery which makes available self-management on the Internet with a flexible, pay-as-you-go business model. Within the context of Internet of Things, the MQTT (Message Queuing Telemetry Transport) protocol that is implemented broadly by the applications of “Publish-Subscribe” paradigm has a vital role. However, MQTT brokers are saturated easily if they have to cope with huge and speedy data generated by IoT “chatty” devices. With capability of provisioning/deprovisioning granular virtual resources, Cloud computing empowered MQTT brokers by enabling its elasticity feature. Elasticity helps the brokers deal with a very large variety of data integrated into the IoT every single day. However, there was lack of sturdy benchmarking tools that judge all the aspects of MQTT brokers in order to advocate correct elastic decision-making. This article focuses on the work of benchmarking MQTT by introducing a new developed tool called MQTTBrokerBench. With this tool, users not only can benchmark MQTT brokers but also can specify saturation points where the IoT load makes the brokers be saturated. Those saturation points can be used to set thresholds for elastic decision-making. Furthermore, the article also demonstrates the results acquired by this tool through the experiments on Windows Azure Cloud Platform.
date: 2019-12-01
date_type: published
publisher: Science Publishing Group
official_url: http://www.sciencepublishinggroup.com/journal/paperinfo?journalid=517&doi=10.11648/j.ijics.20190404.11
contact_email: linhmp@vnu.edu.vn
full_text_status: public
publication: International Journal of Information and Communication Sciences
volume: 4
number: 4
pagerange: 70-78
refereed: TRUE
issn: 2575-1719
referencetext: [1] P. T. Eugster, P. A. Felber, R. Guerraoui and A. M. Kermarrec, The many faces of publish/subscribe, ACM Computing Survey, vol. 35, no. 2, pp. 114-131, Jun. 2003.
[2] MQTT, http://mqtt.org/, visited on June 2019.
[3] I. M. Llorente, Key challenges in Cloud Computing to Enable Future Internet of Things, Keynote speech, Jan 2012. [Online]. Available: http://fr.slideshare.net/llorente/challenges-incloud-computing-to-enable-future-internet-of-things-v03.
[4] Smarter Planet, http://www.ibm.com/smarterplanet/us/en/, visited on June 2019.
[5] Y. Zhao, K. Kim and N. Venkatasubramanian, DYNATOPS: a dynamic topic-based publish/subscribe architecture, ACM
DEBS 2013, pp. 75-86.
[6] L. M. Pham and T. T. Nguyen, Flexible deployment of
component-based distributed applications on the Cloud and
beyond, KSII Transactions on Internet and Information
Systems, 13, 3, (2019), 1141-1163.
[7] MQTTBrokerBench, https://github.com/fimocode/mqttbench, visited on June 2019.
[8] Apache JMeter, http://jmeter.apache.org/, visited on June 2019.
[9] CLIF Server, http://clif.ow2.org, visited on June 2019.
[10] Gatling, http://gatling.io, visited on June 2019.
[11] E. Cecchet, V. Udayabhanu, T. Wood and P. Shenoy, BenchLab: An Open Testbed for Realistic Benchmarking of Web Applications, in usENIX WebApps, 2011, pp. 4-4.
[12] MQTT FuseSource, https://github.com/fusesource/mqtt-client, visited on June 2019.
[13] Sysstat, http://sebastien.godard.pagesperso-orange.fr/, visited on June 2019.
[14] Mosquitto, http://mosquitto.org/, visited on June 2019.
[15] L. Durkop, B. Czybik and J. Jasperneite, Performance
evaluation of M2M protocols over cellular networks in a lab environment, ICIN, pp. 70, 75, 17-19 Feb. 2015.
[16] D. Thangavel, X. Ma, A. Valera, H. Tan and C.K.-Y. Tan, Performance evaluation of MQTT and CoAP via a common
middleware, IEEE ISSNIP, pp. 1, 6, 21-24 April 2014.
[17] A. Giuliani, MQTT benchmarks with RabbitMQ & ActiveMQ, June 2014. [Online]. Available: http://www.ekito.fr/people/mqtt-benchmarks-rabbitmq-activemq/.
[18] Scalagent, Benchmark of MQTT servers, Jan 2015. [Online]. Available: http://www.scalagent.com/IMG/pdf/Benchmark MQTT servers-v1-1.pdf.
[19] SmartBear, MQTT Test Steps, [Online]. Available:
https://smartbear.com/plugins/mqtt-teststeps-page/, visited on June 2019.
funders: Vietnam National University, Hanoi/ VNU University of Engineering and Technology
funders: Graduate University of Science and Technology, Vietnam Academy of Science and Technology
funders: National Key Laboratory of Networking and Multimedia, Vietnam Academy of Science and Technology
funders: Institute of Information Technology, Vietnam Academy of Science and Technology
projects: CN19.09
projects: GUST.STS.ĐT2019-TT02
projects: CS19.19
projects: PTNTĐ19.02
citation:   Pham, Manh Linh and Nguyen, Truong Thang and Tran, Manh Dong  (2019) A Benchmarking Tool for Elastic MQTT Brokers in IoT Applications.  International Journal of Information and Communication Sciences, 4  (4).   pp. 70-78.  ISSN 2575-1719     
document_url: https://eprints.uet.vnu.edu.vn/eprints/id/eprint/3588/1/10.11648.j.ijics.20190404.11.pdf