Progress of IoT Research Technologies and Applications Serving Hajj and Umrah.

The term IoT technology is associated with many fields, including scientific, commercial, industrial, health, transportation and other fields, which became a necessity of daily life across all segments of society. Artificial intelligence, the Internet of things, data science and big data are among the most prominent fields of technologies in the modern era of e-knowledge, which are increasingly being relied on in many areas of our life. This research is considered very special and urgent affecting around 20% of the humanities, i.e., Muslim people, whom try to be selected to perform Islamic rituals every year. Given this importance of applying and adapting technologies to serve Hajj and Umrah performers, it is necessary to conduct an analytical study for the technologies and their applications that have been applied in the Hajj and Umrah system. The surveyed studies have been classified, according to their targeted services (focus area), into four main branches, including studies of the two holy mosques and the holy sites, studies of the pre-arrival visitors, housing and services studies, and transportation and crowd management studies. The classified studies were analyzed according to research field, research instrument, statistical method, nature of statistical data, data collection tools, and research citations. The paper outcome opens novel research practical directions selected based on holistic overview of the current technologies analytical survey, which is essential to be considered to improve Hajj and Umrah services coping with today's technology, in addition to discussing other open issues that need further deep research. © King Fahd University of Petroleum & Minerals 2021.

Introduction

In the past few years, the world witnessed a clear and significant development in the field of IoT technologies in many different sectors and areas of human activities [1]. Nowadays, technology applications have become the essence of the development and prosperity of peoples and countries across the world and in sensitive services [2]. For example, we find medical doctors [3] rely on advanced technical equipment to diagnose many diseases that help determine the type of illness with a high degree of accuracy [4]. We also find the effect of applications in the production lines of many industrial and commercial companies that work to reduce time and raise the level of actions [5]. Similarly, technologies play an active and important role in the educational environment, whether in schools or educational centers or universities [6]. The IoT technology is increasingly involved in numerous vertical applications that address a range of individual and community needs [7], including media [8] and data conversations [9], banking services [2], detection systems [10, 11], smart cities [12, 13], military applications [14], shopping and movement facilitations [15], local and international education [16], entertainment and medical services [17], and many others [18-22].

IoT Technologies and their applications have also gained tangible attention in the Hajj and Umrah crowd systems [23, 24], which their impact evident in many places in the two holy cities, Makkah and Madinah, including the two holy mosques, the holy sites, galleries, libraries, and museums [25]. As considered, Hajj is one of the Five Pillars of Islam, the basic acts that all Muslims are supposed to perform at least once in life. The pilgrimage follows the path of the prophet Muhammad (peace be upon him), as a way of deepening hajjis' connection with the prophet and his teachings. Walking the path of the pilgrimage is also supposed to demonstrate their submission to God ("Allah" in Arabic) [26]. The path of the Hajj follows unique steps, spread out over several days causing some specific massive crowd challenges, as all activities are performed collectively in same time. Hajjis’ first arrive at the Miqat (or starting point) for their place of origin. From then on, they enter a holy state called Ihram, i.e., refraining from certain activities, and wearing a plain white cloth. The uniform is meant to show the equality of all the pilgrims [27]. The pilgrims go to Makkah visiting the grand mosque that houses the Kaaba, the holiest site in Islam. At the Kaaba holy mosque, the pilgrims perform tawaf that involves circling counterclockwise around the Kaaba [23]. Then, i.e., after tawaf, the pilgrims go to the nearby hills of Safa and Marwah for walking between them seven times, in ritual called Sa'ay. After Sa'ay, the pilgrims groom their hair. Hajjis then depart Makkah and holy mosque heading to the nearby area called Mina. The pilgrims can stay for a night or two, then on morning of ninth day of Hajj month, they go from Mina to Mount Arafat spending their day until sunset. Pilgrims then leave Mount Arafat to nearby area called Muzdalifah, i.e., heading back to Makkah sleeping in a raw precise area between Mina and Arafat. All the journey involves the normal course of daily prayers and full of gathering and individual activities. Next, Hajjis’ go back to Mina with the pebbles to be thrown at stone wall (Jamarat), i.e., known as Ramy Al-Jamarat. Thereafter, pilgrims sacrifice animals that begin the holiday Eid al-Adha, or the feast of the sacrifice, which honors Prophet Ibrahim and Ismail (peace be upon them), followed by activity of pilgrims again cutting their hair. After completing some rituals in Mina and Makkah, many Hajjis will then elect to go on a trip to Madinah, as the other holy city that houses the tomb of Prophet Muhammad (peace be upon him), which is an optional trip that most pilgrimages perform before or after Hajj. This Hajj journey can be visualized in brief as in Fig. 1.

Fig. 1

The Hajj trip overview forming the research four main categorize

The IoT ecosystem mainly consists of four components, including sensors, communication, data processing, and user interface [28]. The integration of these components allows beneficiaries to connect to their IoT devices and allow them to perform multiple operations, including remote control, data analysis, dashboards, data storage, and security [29]. The overview of the Hajj and Umrah framework forced us to categorize research into four main branches that need a specific professional focus in addition to integration with each other. These four branches have been covering:

the two holy mosques and the holy sites (Location-based studies)

the pre-arrival studies (Logistics investigation)

housing and services studies (Community and social studies)

the transportation and crowd management (Human movement/transportation)

These four main research branches must be considered to help clarify the position of research interests of researchers in the field of technologies that serve visitors and service providers., i.e., to the two holy mosques within Saudi Arabia; similar in principle to the sophisticated pedestrian-vehicle conflicts within Madinah Holy city [30] and Train service first testing for Hajj in Makkah Holy city [31]. We, in this research, pointed to a set of new technologies and challenges [32], but focused our attention for serving Makkah pilgrims and Umrah performers, as well as Madinah visitors.

The survey analysis background and study further benefitted from the approach of the survey paper of machine learning (ML) algorithms for wireless sensor networks [33], which covered various ML-based algorithms exploring their advantages, drawbacks, and parameters effecting the network lifetime opening the research for more statistical analysis and techniques reasons. However, our study found different variations within the focus of every paper making the overall comparison unfair at this stage. Furthermore, this research is considered one of the limited researches that provides top-view analytical study of the researches that are conducted within the scope of IoT technologies and their applications within Hajj and Umrah systems. Recently published researches are reviewed, analyzed and discussed according to their characteristics. Moreover, several research proposals were recommended, in addition to discussing other open issues that need further deep research. Note also an important objective of this research to become the main trusted reference and starting point as well as motivational fuel for future scientific practical projects for Hajj and Umrah IoT and technology applications researchers, in addition to related local and international decision-makers.

The flow of our research paper is as follows. The second section presents briefing of the previous studies in the field of technologies and their applications within Hajj and Umrah system. The third section briefs the methodology used in this research. The fourth section discussed the analysis and presentation of the results. The fifth section proposes some outcome future proposals ideas that can be applied in the Hajj and Umrah system. The sixth section presented open challenging issues in relation to our review. Finally, the seventh section concludes the paper.

Literature Review

This section presents the researches that were conducted in the field of the Hajj and Umrah technologies and their applications, which were published in the past five years (2016–2020). The research has been classified into four major branches: The two holy mosques and the holy sites, the pre-arrival studies, housing and services studies, and the transportation and Crowd Management studies.

The Two Holy Mosques and the Holy Sites

The institutions operating in the Hajj and Umrah system develop strategic plans and upgrade and improve the infrastructure to serve millions of pilgrims and Umrah performers and enrich their religious experience, especially in the two holy mosques and the holy sites. According to the Hajj and Umrah vision realization program [34], the branch of the two holy mosques and holy sites received the highest score of contacting points during the guest’s trip. The branch contained several parts, including crowd management, services of holy sites, guidance services, and housing in Mina (one of the holy sites in Makkah) [24].

Due to the limited Hajj area space of Mina, many studies represents it as a major challenge of how to efficiently distribute its camps and services. Accordingly, Shambour et al. [35] developed a framework to effectively distribute the Mina camps. The proposed framework depends on the application of artificial intelligence techniques using geographic data for the entire Mina area, considering hard and soft constraints. The recommendations indicated that the proposed technology helps to make use of the maximum capacity of the available resources, which will lead to increase in the capacity of the Mina area. Later, Shambour and Khan [36] proposed a heuristic approach to distribute pilgrims over Mina camps. The proposed algorithm showed an efficient performance, in terms of space allocation, as 80% of the pilgrims were allocated over 76.2% of the total accommodation place of Mina area.

Al-Quhtani [37] claimed that MIMO improved the capacity and accuracy of wireless channels, which made it a candidate for the fifth generation (5G) cellular system. According to that, the author suggested the use of MIMO to improve the performance of large-scale wireless sensor networks in holy sites. This, in turn, leads to many beneficial uses such as public safety and surveillance in all different areas. Haase et al. [38] presented an integer programming model to utilize resource infrastructure to improve the capacity of Mina area and to avoid the densities of dangerous pedestrian in the road network. Simulation results of scheduling pilgrims who performing stoning rituals verified the integrity of the scheduling process and the effectiveness of scheduling parameters.

Yasein et al. [39] studied the use of the smart camp in Mina’s site using IoT technology. The authors aimed to demonstrate how to intelligently control the various functions and conditions of smart camps using internet-connected sensors. The experimental results showed the success of the implemented case study in capturing sensor data, with the use of a smart mobile phone successfully in remote control, with the possibility of using sensors to obtain services and other information. In another study, Yasein [40] conducted three simulation scenarios for how visitors enter the Prophet's Mosque of Al-Salam Gate during peak times in the holidays. The Author imposed the presence of 10,000 visitors during 16:40 min at a rate of 600 visitors per minute and placed a fence surrounding the Al-Salam Gate on three sides.

Felemban et al. [41] simulated the movement of crowds around the Kaaba at the Grand Mosque of Makkah. Allocated cameras in the Grand Mosque were used to collect the required data in order to obtain the parameters necessary to design the model. The Mass-Motion software was used to build the model. The results of the model showed important information about the density and patterns of crowd movement, especially in the important areas of the Makkah Grand Mosque, as related to improve work of [24], which helps to preserve crowd safety and save the effort and cost in the process of organizing crowds [15]. Ali and Al-Masud [42] applied the Bees algorithm to explore the shortest path of health data, collected using wireless body area networks (WBANs), during congestion in the Hajj environment. the proposed algorithm provides efficient results in terms of energy consumption, delay, and transmission time, which is different than the data dissemination and collection work of [18].

In other crowd research, Yasein et al. [43] simulated the large and dynamic movement of crowds in the areas of the Prophet’s Mosque in Madinah to reduce risks and support decision-making. This was done by analyzing the simultaneous simulation of the interaction of a group of elements in the model environment, which is an advancement to previous microscopic modeling of large-scale pedestrian-vehicle conflicts in the city of Madinah work [30].

AlQurashi and Altman [44] applied a multilevel and phased model based on individuals to simulate crowd movement on the surface of the Holy Mosque in Makkah, similar to principle-related research [15]. The aim of the enhanced research of [44] was to simulate real behaviors and phenomena with high accuracy rate to improve the complex crowd management process in different circumstances. In addition to automating the decision-making process during mass evacuations in critical incidents, the researchers used a proposed model in a multilevel evidence to manage general crowd and individual behaviors. The results showed that the model was able to support heterogeneity and high density.

An interactive scheduling method for groups of pilgrims has been proposed by Rehman and Felemban [45]. The proposed method reschedules groups of pilgrims according to their preferences to perform the stoning rituals et al.-Jamarat building within Mina area. Safety and time preferences are the primary factors taken into consideration during the optimization process. The method was successfully applied to reschedule the movements of pilgrims during Hajj season 2019 showing interesting results.

The lack of computational requirements in the current sequential systems urged Majid et al. [46] to present a parallel system for large-scale agent-based crowd simulation. The system simulates the circumambulation of pilgrims around the Ka'aba using existing OpenSteer library, where it was simulated for 100,000 pilgrims in 10 frames per second.

Mohamed and Parvez [47] proposed a finite state machine model to simulate the movement of crowds around Ka'aba within Makkah Holy grand mosque. The proposed model aimed to facilitate the touching and kissing of the black stone by pilgrims in a very smart manner. Table 1 shows a summary of previous research related to the two holy mosques and the holy sites. It can be seen (from Table 1) that very little realistic research studies have been performed in the last few years, especially in 2020 that no research has been conducted due to Corona Virus (Covid-19) epidemics.

Table 1

Research collection according to the research branches of two holy mosques and the holy sites

# of Researches (2016)	# of Researches (2017)	# of Researches (2018)	# of Researches (2019)	# of Researches (2020)	Total	References
1	3	3	6	–	13	[35–47]

The Pre-arrival Studies

This section discusses the studies of the performers of Hajj and Umrah, starting from planning the trip in their country until their arrival to the two holy mosques in Makkah and Madinah. Before arrival, there are many tasks and rituals that pilgrims must perform. Therefore, all sectors of Hajj and Umrah work together to facilitate the various services that pilgrims need during their stay to make their rituals convenient and comfortable.

Interestingly, Hamroun and Lajmi [48] adopted a database program to index 1,000 videos related to the rituals needed by Hajj and Umrah performers. The observed results indicated that the inquiry process is very useful for serving pilgrims as it is able to simulate appropriate rituals for Hajj and Umrah activities.

Shambour et al. [49] used two methods to evaluate websites that provide services related to the rituals of Hajj and Umrah. The researchers used the Google search engine to search for sites that include issues related to visiting the holy cities of Makkah and Madinah. The research results highlighted several general weaknesses in the presence of Islamic websites on the Alexa World site list. Specifically, the two websites "IslamWeb" and "Ministry of Hajj and Umrah" got the highest rating of 4,13 and 4.07 (out of 5), respectively, indicating correct technology direction. There were also weaknesses in providing adequate tools for communication and interaction between all users of Islamic websites. The study also recommended the necessity of professional interest in developing Islamic websites, preserving their contents and updating them periodically.

Elgamal and Alshamarani [50] studied the characteristics of pilgrims in terms of their interests and behaviors during their ritual journey. The researchers obtained data from the records of the Custodian of the two holy mosques Institute for Hajj and Umrah Research (Hajj Research Institute). The collected data were used to explore hidden relationships between the various variables and to present the information visually. In another study, Khoj and Issa [51] proposed a system to clarify the possible ways to distribute the electrical energy and water resources available in Makkah, and the optimal distribution that achieves the minimum efficiency of medical facilities to mitigate risks and conditions, needing more health techno service attention [3]. The consequences of any disaster or pest are considered making huge impact as ensured within the sustainability of their work [51]. Relatively, Utama et al. [52] presented an optimization method to determine the Hajj performers among other candidates for current year quota in Indonesia. The proposed Utama method is interestingly based on Fuzzy logic and human hill climbing ability algorithm. The objective function involved seven different factors, including job, registration date, officer type status, couple status, health, Hajj status, and age [52].

In other works, Khan and Shambour [23] provided an analytical study for the implemented services of Hajj and Umrah mobile applications. The study covered 246 different Apps from Google Play store. Also, a MARS evaluation tool was used to evaluate several Apps of Hajj and Umrah services. Recently, Basalamah & Rehman [53] presented a survey for Hajj Apps that included 51 Apps, which have been classified according to five main groups, namely, ritual services, location-based services, Context-based Services, navigation services, and other services. The studied apps have been organized according to several factors including individual service, languages, and group of services based on downloads.

Also, Khwaja [54] presented a real-time database management system (DBMS) to improve immigration procedures in Saudi ports during the Hajj season. A free distributed database system, called Sensei DBMS, was implemented and tested on thousands of dummy data records to ensure the system validity. Similarly, in order to promote learning styles that enhance learners' satisfaction, some studies have discussed the possibility of employing the technology of multimedia and virtual reality as an educational source to teach more about Hajj and Umrah rituals and their related issues such as research works presented in 3D-media simulation for hajj [55], virtual Umrah interface satisfaction [56], interactive hajj learning [57], virtual hajj tour [58], augmented reality acceptance while performing hajj [59], virtual simulation hajj teaching [60] augmented reality infographic Umrah technology [61].

Table 2 presents a summary of previous research related to the pre-arrival studies. Similar results were noted as those of previous research conducted in the two holy mosques and holy sites branch. This reveals that the researchers’ trend is not very directed toward the topics of the previous two branches, in contrast to the two following branches that will be presented later.

Table 2

Research collection according to the research branch of the pre-arrival studies

# of Researches (2016)	# of Researches (2017)	# of Researches (2018)	# of Researches (2019)	# of Researches (2020)	Total	References
2	5	5	2	2	16	[3, 23, 48–61]

Housing and Services Studies

The services provided in housing, subsistence, shopping and other services are among the basic requirements that are badly needed by the pilgrims and Umrah performers. For instance, Shambour et al. [62] conducted a study that predicts the water and electricity needs within Makkah region in the month of Ramadan for the years 1440–1441 AH by analyzing data from five previous years. The authors applied NN algorithm to analyze the data and predict the future needed. Relatively, Marjan and Khayat [63] proposed improvement methodology aimed at reducing the distance between service points in the holy sites. Authors employed genetic algorithms (GA) to find the best distribution of service points in the holy sites for visitors and pilgrims to obtain the maximum performance. Service points include police cars, ambulances, fire trucks, food, water and other drinks trucks, and surveillance cameras. As a case study, authors applied the algorithm to distribute ambulances at Arafat holy site crowded area.

Khairullah and Ashari [64] have applied an algorithm to search for user preferences regarding Hajj and Umrah companies. The aim was to facilitate the search and obtain the desired results. The study recommended establishing a database for the preferences of pilgrims and Umrah performers, and providing the most important services, such as the location of medical centers that are near Hajj and Umrah companies.

Munir et al. [65] monitored and modeled pollutant emissions in Makkah from the burning of gas, gasoline and diesel consumed in residential homes, road traffic and electricity generation in Makkah at year 2015. Emissions were entered as network sources in the Atmospheric Dispersion Modeling System, and the outputs were presented as ocean maps for different emissions and meteorological scenarios. In other works, Authors in [27, 66] studied the benefit of applying visual representation of big data to improve Hajj and Umrah services. Authors presented two cases that were reviewed, the first for the number of pilgrims and workers, and the second for housing pilgrims within Makkah. Researchers [27, 66] emphasized that using data visualization in an exploratory manner is one of the most effective ways to benefit from big data and help improve Hajj and Umrah services. Alkhateeb [67] proposed an iris recognition system to identify missing pilgrims using a neural network probability classifier. The proposed system showed acceptable performance with a recognition rate of 86%. Moreover, Hijry and Olawoyin [68] presented a machine learning method to predict the length of stay of a Hajj patient in the hospital's emergency departments to get the service. The presented method applied NN, linear regression, and logistic regression models.

Baqui and Löhner [69] addressed the real-time monitoring at the Hajj activities. The proposed method is based on taking photos in a sequence of time lapse which are divided into smaller blocks. Afterward, the cross-correlation is applied on each divided block to compute component wise inner product. The histogram of oriented gradients model was used to count the heads in image segments. Finally, the coordinate transformation technique was employed to convert image pixels into 3D world coordinates. Alshammari et al. [70] discussed the feasibility of developing an effective simulation model to track diseases during the Hajj season. The simulation results showed that the spread of the disease is greatly influenced by the demographics of pilgrims and their mobility patterns during the various stages of the Hajj.

A bottom-up segmentation approach of handwritten Arabic texts was introduced by Al-Snoussi and Wahabi [71] to provide lessons and guidelines for Hajj actions according to the spatial and temporal context of the Hajj rituals. The proposed approach extracts the outer isothetic cover of different Arabic text resources in various textual forms including skewed and curved text lines for words and part of words. Batarfi et al. [72] proposed an Arabic semantic lexicon system for Hajj. Authors augmented Arabic dictionary with semantic features and morphological information. The proposed system has two process phases, handling Hajj documents and constructing lexicon processes. The first phase process delivers the hajj file document and convert it to an XML file format. The second phase process receives the produced XML file document and builds a semantic lexicon.

The impact of information and communication technologies on the social experience of Hajj was discussed in the study of Qurashi and Sharpley [73]. The authors argue that despite users' benefits from using smart phone technologies (such as the online Hajj portal, social media sites, Islamic apps, and Wi-Fi services), it negatively impacts their spiritual experience. Elgamal [74] proposed a sentiment analysis method for Hajj-related tweets in English language. The tweets are divided into three stages, including coding, normalization, and part of speech tagging. Then, a Naïve Bayes classifier was applied to classify the type of each Tweet into positive or negative classes. This tweets analysis of [74] is completely different than the security tweets study presented in [75], although the security analysis survey is found very useful within this research for the importance classification strategy to be elaborated later.

In other related researches, Jassas et al. [76] conducted a study on smart system that links medical sensors with cloud computing, i.e., to reduce the time required to serve the largest number of patients during Hajj. The study aimed to design and implement a smart network system for e-health during the Hajj period to solve the problem of delayed arrival of patients’ medical information to caregivers. Authors in [77] and [78] presented a fog computing framework to eliminate packet delay and bottleneck problems during Hajj heavy crowded days. The fundamentals points of the presented frameworks focused on handling inquiries of end-users at the fog nodes layer, and effectively managing communications between fog nodes and the cloud server. Also, Nafea in [79, 80] proposed a healthcare model based on big data and cloud computing that collects pilgrims' data from Hajj-related ministries in the Kingdom of Saudi Arabia. The collected data are used to extract patterns that control disease spread during Hajj. In the same context, Eldein et al. [81] studied the healthcare procedures in Hajj and Umrah system. Authors in [81] discussed the detailed requirements for the proposed system to develop a mobile healthcare system. Related issues have been also discussed in [82-86]. Moreover, a survey of technological issues in the health monitoring of pilgrims has been conducted in [87] and its links to security have been covered in [4, 5].

For real-time language assistance services during Hajj and Umrah visits, Abdelazeez and Shaout [88] provided a multilingual translation system for pilgrims to assist them while performing their rituals. Many studies have employed variety of smart apps to support and serve Hajj and Umrah performers on their holy journey, such as tracking, monitoring, learning, locating, recognition, notifications, and many other services as discussed differently in researches, such as Hajj app for iOS [89], dynamic crowd monitoring [90], Android Hajj monitoring application [91], HAJJRAH application [92], smart face recognition for lost & found [26], intelligent items identifying [93], Hujjaj tracking [94], tracking losses within crowds [95], intelligent HAJJ guide [96], tracking within crowds [97], integrating social media with mobile apps for Hajj management [98], M-HAJJ DSS [99], and context-aware mobile framework for Hajj management [100].

Table 3 provides a summary of previous research related to the housing and services studies. Although the total number of researches reached 43, with an average of 8.6 researches annually, we find that the number of researches continues to decline over the years.

Table 3

Research collection according to the research branch of housing and services studies

# of Researches (2016)	# of Researches (2017)	# of Researches (2018)	# of Researches (2019)	# of Researches (2020)	Total	References
10	10	9	8	6	43	[4, 5, 26, 27, 62–100]

Transportation and Crowd Management Studies

Yasein and Alharthi [101] studied several technological techniques used in tracking and guiding pilgrims during the Hajj and Umrah seasons. The researchers compared different systems—GPS, land-based tracking systems, RFID/NFC, Bluetooth, Wi-Fi, Scene analysis based on image examination systems, Barcode systems and Hybrid Solutions. The researchers pointed out the possibility of making use of these systems and employing them to serve pilgrims and Umrah performers. Osman [102] proposed a system to ensure safety and guidance for pilgrims while performing Hajj and Umrah rituals. The NFC technology was applied to track and identify pilgrims in crowded places.

Alkhuzaim and Altahhan [103] conducted a study to estimate crowd density at the Grand Mosque using neural network (NN) algorithm. The study aimed to provide guidance to pilgrims and visitors to increase awareness and safety. The authors recommend the NN model because it has an effective image classification performance, which can be used in estimating crowd density and classifying images and videos in a crowded scene. Relatively, Jabbari et al. [104] proposed a framework for solving crowd collision problem by using a mobile device to sense the risk of collision before it occurs. The researchers based their work on using wristbands of personal information and locater chip. Bracelets have been used assuming "low-power Bluetooth" to locate persons by sending signals to the sensors on the roads that the pilgrims walking to discover the crowds. These crowd analysis remarks are based on Hajj simulations research of huge gatherings [15] as well as right of way interactions [24].

Data dissemination and collections [18] as well as head detection methods of Musa et al. [105] are useful to count the pilgrimage crowds by segmenting the head regions from static images. The researches aimed to determine the potential of stampede early in order to alert people to take necessary procedures. Similarly, Khan et al. [106] proposed a framework for improving crowd management within Hajj activities assuming computer vision technology to be used to analyze video footage automatically. Authors applied different contrast video footage, previously recorded manually, to be able to measure and evaluate the crowds. Then, models were built using neural networks to extract important information such as estimating crowd real-time density, determining the prevailing patterns of movement, and discovering and identifying areas of congestion [24].

An optimization method was suggested by Felemban et al. [107] to schedule the movement of pilgrims using the train during the Hajj days, as previously tested in research [25, 31]. The authors of [107] identified three factors that affect the scheduling process, which are the type of train movement, the location of the pilgrim camp, and the camps to the permitted stations and vice versa. The proposed method was applied during Hajj season 2019, and an analytical comparison was made between the actual and scheduled times for each train station.

Seddiq et al. [108] studied the evaluation of crowd congestion using variable resolution clustering. The study aimed at creating an algorithm capable of detecting crowding environments and assessing the level of gathering severity in three levels of the scale as follows: No congestion, mild congestion, and severe congestion, different than old work of [30]. The Seddiq study [108] recommended a demonstration of the usefulness of multi-circular clustering in assessing massive crowd congestion. Interestingly, Amer and AlMatrafi [109] used multi-agent system (MAS) to organize negotiations between Hajj administrations and campaign organizers, i.e., to evacuate the pilgrims during peak times. The MAS proposed system set timetable schedules for pilgrims traveling from Arafat to Muzdalifah in addition to automated RFID gates, which can detect buses that do not adhere to the plan. The study indicated the need to use a multi-agent system to automate negotiations between Hajj authorities and travel agents to make the schedule setting process open and fair, in addition to using automated RFID gates to prevent buses without a valid card to reach the holy Makkah city.

Namoun et al. [110] applied the support vector machine with the concept of fuzzy logic to simulate the behaviors and movements of pilgrims in panic situations. The authors aimed to find appropriate evacuation models to avoid the possibility of disaster occurring. The results showed that the algorithm can select the best representative crowds of pilgrims that better reflect their behavior. Differently, to understand the behavior of the pilgrims crowd during Hajj days, Felemban et al. [111] employed an application system to collect and analyze pilgrims data in a space and time domains to explore their movement information such as selected path, starting time, duration time, and the movement speed.

A machine learning approach for detecting the crowd congestion in Hajj was proposed by Islam et al. [112]. The proposed system employed three bracelet sensors to collect the required data, including the sensors of temperature, humidity, and accelerometer. The collected data were then used to predict stampede potential using K-Nearest Neighbors and decision tree algorithms. Similarly, a framework for distributing and controlling visitors of a crowded area was proposed by Mohamed et al. [113]. This proposed framework consists of three layers, including sensor, management, and interface layers. These layers are used for collecting data, analyzing data, and providing appropriate decision, respectively. The proposed framework aimed to provide users with information about the current condition of roads and doors, the locations of non-congested areas, and the locations of friends and groups.

A framework for managing and monitoring Hajj crowed was offered by Nasser et al. [114]. Authors discussed the use of smart monitoring of paths in the Mina’s tents and Al-Jamarat building as a congestion detection and prediction tool. The proposed framework was evaluated against three scheduling mechanisms, first-in-first-out, priority queuing, and weighted round robin mechanisms, where interesting remarks have been gained.

Mahmood et al. [115] presented an agent-based crowd simulation framework for crowd evacuation strategies. The proposed framework is designed to simulate the behavior of large crowd in a real scale spatially environment and to assess evacuation strategies. In the same context, a game theory approach for crowd management service during Hajj was introduced by Nasser et al. [116]. The main objective of the study was to avoid bottleneck for pedestrians during stoning ritual at the Jamarat building. Furthermore, Mnasri and Farhat [117] studied the crowd dynamics of pilgrims in the Jamarat building during the Hajj and presented three proposals to improve crowd movement management. Alazbah and Zafar [118] employed a convolutional neural network algorithm to detect congestion in the Jamarat building during ritual stone-throwing. The algorithm was trained using different classification images taken from actual video of crowds walking on the Jamarat route. The proposed algorithm presented the crowded condition according to three categories including crowded, semi-congested, and normal. Authors in [119, 120] studied bus traffic during the 2018 Hajj season using a large-scale Global Positioning System (GPS). Data of about 20,000 buses were collected, analyzed and visualized through an advanced interactive platform. Also, the algorithm presented in [120] applies the concept of avoiding spatial anomaly by ensuring that there is no cross-movement of the evacuees during the evacuation.

Alrabghi [121] offered a flow simulation model for passengers at Hajj terminal in the king Abdulaziz international airport during peak times. Various simulation scenarios were applied to explore the best waiting times for passengers. Results show that the passengers’ flow could be improved by enhancing the procedures of certain policies without the need to increase the existing resources. Authors in [122, 123] discussed the efficiency of using wireless and mobile technologies in large crowded events. The author discussed the use of radio frequency identification (RFID) to monitor and control crowd movements, as well as the use of a fog computing system that reduces processing and communication costs on the cloud system. Also, Jabbari et al. [124] proposed an intelligent crowd system to avoid the potential for disaster during Hajj by using real-time data analyzes of Bluetooth Low Energy data. The proposed system can define multiple crowd measures including direction, location, velocity, and density. Other related works have been also discussed in [125-130].

Table 4 shows a summary of previous research related to the transportation and crowd management studies. The results indicated that the total number of researches reached 30, and that half of these researches were conducted in 2019, and it was noticed that the lowest number of researches in all branches studied was in 2020. We strongly expected that the main reason behind this is because of the spread of the Covid-19 pandemic. In addition to the precautionary measures that make it difficult for researchers to conduct their studies during that time.

Table 4

Research collection according to research branch of transportation and crowd management studies

# of Researches (2016)	# of Researches (2017)	# of Researches (2018)	# of Researches (2019)	# of Researches (2020)	Total	References
3	6	4	15	2	30	[101–130]

Considering all these related works, we attempt to overview Hajj and Umrah research as overall complementary study that has been remarked as fundamental background within this scientific review work. This holistic overview made-up our methodology of four stages classification as elaborated next.

Methodology

The research methodology used in this paper is illustrated in Fig. 2 as four stages for understandable consideration. The first stage begins with an overview of the previous research works related to the technologies and their applications in Hajj and Umrah system. We are categorizing the first stage into their related research fields, including studies of the two holy mosques and the holy sites, the pre-arrival studies, housing and services studies, and the transportation and crowd management studies.

Fig. 2

Research methodology

In the following stage, Stage 2, the categorized studies were further classified according to six sub-categories: research field, research instrument, statistical method, nature of statistical data, data collection tools, and research citations. Then, Stage 3 covers analysis of the results as thoroughly presented and discussed in a separate stage. Finally, Stage 4 comes from the user prospective looking into applications and modern technologies that can be applied in the Hajj and Umrah system, which are suggested and discussed in depth, in addition to discussing other open issues that need further deep research.

Data Analyses and Discussion

This section presents the results of research analysis according to the six subcategories mentioned earlier. Table 5 shows that previous research falls into nine scientific research fields: artificial intelligence (AI) and machine learning, simulation and modeling, image processing, data science and big data, the Internet of things (IoT), database, virtual augmented reality and information system.

Table 5

Research classifications according to scientific fields

Scientific fields	# of Researches (2016)	# of Researches (2017)	# of Researches (2018)	# of Researches (2019)	# of Researches (2020)	References
Artificial intelligence (AI) and machine learning	7	3	8	16	5	[26, 35, 36, 38, 42, 45, 46, 51, 52, 62–64, 67–69, 74, 89–98, 100, 102, 103, 105, 107, 109–112, 118–120, 124
Simulation and modeling	3	3	3	6	–	[38, 40, 41, 43, 44, 46, 47, 65, 70, 110, 114–117, 121]
Image processing	–	4	2	4	–	[26, 67, 69, 71, 93, 103, 105, 106, 108, 118]
Data science and data big	1	2	1	3	–	[27, 49, 50, 66, 71, 119, 120]
Internet of things (Iot)	1	5	1	7	1	[39, 76–82, 91, 104, 108, 112, 113, 122, 123]
Data communication	2	2	7	4	–	[37, 83, 85–87, 90, 101, 122–124, 126–130]
Database	2	2	–	–	–	[48, 55, 69, 88]
Virtual and augmented reality	1	2	4	–	–	[55–61]
Information system	1	2	1	1	2	[23, 53, 71–73, 88, 125]
Total percentage of scientific fields	15.1%	21.0%	22.7%	34.5%	6.7%

This work has been investigated all together as studies published per year via percentage of researches published in 2019 as being the largest resulting at 34.5%. The works have been reconsidered as percentages of fields compared to each other, as shown in Fig. 3.

Fig. 3

Trends of scientific field studies

The results (Fig. 3) showed that the bulk of the reviewed research works focused on the field of artificial intelligence and machine learning with ratio 32.2% followed by modeling and simulation, data communication, and IoT, all with similar ratio of 12.7%. Then comes image processing field with 8.5%. It should be noted that missing research in other important areas in the Hajj and Umrah system, can be noted as the field of security and privacy which is becoming very essential in the coming years.

Table 6 presents research instruments adopted by researchers in their research works, which were limited to seven tools: real implementation, simulation and modeling, framework, visualization, survey study, data mining, and evaluation criteria. Results showed that the research works published in 2019 were the largest with 30.8% of the total published work, whereas 2020 was the lowest with 6.7%.

Table 6

Research classifications according to research instruments

Research instruments	# of Researches (2016)	# of Researches (2017)	# of Researches (2018)	# of Researches (2019)	# of Researches (2020)	References
Real implementation	7	8	7	18	4	[26, 36, 39, 42, 45, 46, 48, 52, 54, 62–64, 67–69, 71, 72, 74, 76, 88–96, 99, 100, 102, 105–108, 111, 112, 118–120, 124, 127, 129, 130]
Simulation and modeling	3	4	4	7	–	[37, 38, 40, 41, 43, 46, 47, 51, 58, 70, 109, 110, 113–117, 121]
Framework	4	7	5	4	1	[35, 37, 44, 51, 77–83, 85, 86, 97, 98, 104, 113, 122, 123, 126, 128]
Visualization	2	1	–	2	–	[27, 65, 66, 119, 120]
Survey study	2	4	5	–	2	[23, 53, 55–57, 59–61, 73, 78, 87, 92, 101, 125]
Data mining	–	1	–	1	–	[50, 71]
Evaluation criteria	–	–	1	–	–	[49]
Total percentage of research instruments	17.3%	24.0%	21.2%	30.8%	6.7%

The results in Table 6 have been summarized as percentages shown in Fig. 4, in order to grasp the related research situation. The review showed that real implementation was the most used tool among researchers as ratioed at 42.3%, followed by framework analysis at 20.2%, then modeling and simulation at 17.3%. The survey study has been found less attractive by ratio of 12.5% as understandable ration due to its trusted difficulty in collecting among Hajj and Umrah visitors. The least used tools were data mining by 1.9% and evaluation criteria with 1% as following the evolving method of data visualization showing 4.8%.

Fig. 4

Percentages of research instruments compared as overall studies

Table 7 also displays the classification of the research works according to the used statistical methods, which was classified either as descriptive or Inferential or not available (N/A). Results showed that the research works published in 2019 was the largest with 31.6% of the total published work, whereas 2020 was the lowest with 7.1%.

The results, as shown in Fig. 5, showed that the largest part of the research was based on descriptive statistics by 73.5%. Moreover, the research based on inferential statistics did not exceed 2% of the total research, whereas the rest used N/A as not applicable standard statistical schemes based on the unique Hajj and Umrah ritual situations.

Fig. 5

Percentages of research statistical method used

Table 8 shows the classification of the research works according to the nature of the statistical data, i.e., study data type, which consists of quantitative and qualitative or neither both approaches. These types cannot be standardized since they do not link to normal situations as found naturally in life. Similar to the previous results, the research works published in 2019 was the largest, while the year 2020 was the lowest with 30.4% and 6.9% of the total published works, respectively. The Hajj and Umrah activities are showing interesting features being investigated from different point of views as summarized in Fig. 6.

Table 8

Research classifications according to statistical data type

Statistical data type	# of Researches (2016)	# of Researches (2017)	# of Researches (2018)	# of Researches (2019)	# of Researches (2020)	References
Quantitative data (discontinuous/continuous)	11	17	14	22	6	[23, 26, 27, 36–46, 48, 50–63, 65–72, 74, 76, 78, 87–93, 95, 96, 99, 100, 102, 105–107, 110–112, 114–116, 118–121, 124, 125, 127, 129, 130]
Qualitative (ordinal/nominal)	1	2	3	3	–	[41, 49, 50, 55, 57, 64, 73, 106, 108]
N/a	5	6	5	6	1	[35, 47, 77, 79–83, 85, 86, 94, 97, 98, 101, 103, 104, 109, 113, 117, 122, 123, 126, 128]
Total percentage of statistical data type	16.7%	24.5%	21.6%	30.4%	6.9%

Fig. 6

Percentages of research statistical data type adopted

The results of Table 8 (visualized in Fig. 6) indicated that majority of 68.6% of the researches relied on analysis of quantitative data, either continuous or discontinues. Other 8.8% of the researches based their work on qualitative descriptive data covering ordinal or nominal schemes. Our review turned out that the percentage of researchers who have relied on mixing type data analysis, noted as N/A in Table 7, was the around 22.5%. These N/A not standard statistical data type found using other technical non-standard interesting approaches worth adopting.

The data collection scheme can be different among researches working on Hajj and Umrah activities. For example, Table 9 lists the works classified by mostly using virtual data, basing on software/ technical equipment/ camera tools, involving questionnaire, using official reports and observations, adopting interviews and other technical non-standard interesting approaches (noted as N/A). The results showed that the largest part of research work was conducted in 2019 at 31.7% of the total published works, and the lowest part was found in 2020 at 6.9%.

Table 9

Research classifications according to data collection tools

Data collection tools	# of Researches (2016)	# of Researches (2017)	# of Researches (2018)	# of Researches (2019)	# of Researches (2020)	References
Virtual data	1	4	5	8	1	[36–38, 40, 42–44, 46, 52, 54, 63, 76, 95, 108, 110, 112, 114–116]
Software/technical equipment/cameras	4	3	2	9	1	[38, 39, 41, 65, 69, 78, 89–92, 103, 106, 118–120, 124, 127, 129, 130]
Questionnaire	1	5	5	1	-	[23, 49, 55–57, 59–61, 64, 78, 100, 102]
Official and administrative reports and observations	5	5	3	8	4	[23, 26, 27, 45, 50, 51, 53, 58, 62, 64, 66, 68, 70–72, 74, 87, 88, 93, 96, 99, 105, 107, 111, 125]
Interviews	1		2	1	-	[55, 57, 73, 121]
N/a	5	6	5	5	1	[35, 47, 77, 79–83, 85, 86, 94, 97, 98, 101, 104, 109, 113, 117, 122, 123, 128, 129]
Total percentage of data collection tools	16.8%	22.8%	21.8%	31.7%	6.9%

The data collection tactics are summarized as shown in Fig. 7. In general, the most used approach is the official reports and observations showing 24.8% as they are very clear and fixed. However, their remarks can be considered limited since they do not go deep into the problems or critical situations except what has been reported. Therefore, 18.8% of researches used virtual data modeling as well as software/technical/camera tools. This is followed by 11.9% using the challenging questionnaires.

Fig. 7

Percentages of preferred research data tactics among researches

Finally, Table 10 shows a classification of the number of papers that have been cited by using “Scopus” as well as “Google Scholar” database in relation to Hajj and Umrah Services. The researches covered essential branches classified into the two holy mosques and the holy sites, the pre-arrival studies, housing and services studies, and transportation studies. The total overall researches are found to be 98, where their total Scopus and Google Scholar citations are estimated to be 228 and 315, respectively. These databases results indicate a relatively weak research studies and citation regarding the two holy mosques and holy sites, which is considered low, as can be visualized in percentages shown in Figs. 8 and 9.

Table 10

Research citations according to Scopus and Google Scholar databases

Research branches	# Of research papers	# Of citations (scopus)	# Of citations (google scholar)
The two holy mosques and the holy sites	11	8	10
The pre-arrival studies	15	18	41
Housing and services studies	40	106	155
Transportation studies	32	96	109
Overall related researches all together	98	228	315

Fig. 8

percentages of researches and their citations according to Scopus database

Fig. 9

percentages of researches and their citations according to Google Scholar database

Research Proposals that can be Applied in the Hajj and Umrah System

This section provides some research ideas and practical suggestions that employ technologies to facilitate the services provided to pilgrims, Umrah performers, visitors and service providers. The service providers considered are from all governmental, private and charitable sectors, which we hope will be useful to decision-makers within Hajj and Umrah systems, i.e., for applying their services, as briefed next.

Smart Screen Devices

The use of smart portable screen devices to eliminate the cases of losing pilgrims and Umrah performers. Screen devices are being distributed in certain places in the two holy cities, to help people know where they live in case they get lost. Where the missing person uses the bracelet on the device using (NFC) technology, and the device draws a path from his current location to the desired location using a map and estimates the distance and expected arrival time.

Monitoring System for Abnormal Events

There are many surveillance cameras used in the two holy mosques and the holy sites that perform various security tasks. To monitor all events through cameras, it requires follow-up, focus and great effort on the part of the observers. However, observers may not be able to notice an abnormal event early on, which in turn delays the action to avoid a problem.

Smart Parking System

Developing interactive devices at the main exits leading to large car parks, such as the car parks in Madinah, which helps to identify the vehicle parking location through the vehicle plate number. The devices display the vehicle’s image and guide the user to where the vehicle is parked through an interactive map on the screen, in addition to informing the driver of his/her current location.

Cluster System

Develop a tree-shaped cluster application to organize small groups of Hajj and Umrah performers, each group consists of 50–100 people supervised by a leader who has direct contact with them. The leader directs and identifies members of small groups, and easily locates each group member. The next level is between executives at a higher level, and so on, to facilitate communication and coordination between all pilgrims and Umrah performers, to find lost individuals, and to facilitate movement and mobility. In addition to disseminating information and instructions quickly and easily, even among individuals who do not have access to the Internet or smart devices, through direct communication with the group leader.

Smart Buildings

Expanding the use of the smart building concept using Internet of Things technology. This comes by automatically and smartly controlling the functions and state of the buildings through sensors that track the buildings’ condition, as these sensors provide the necessary data required to automatically control the level of comfort and improve the use of available resources (such as energy and water), in addition to securing the place and maintaining the safety of its residents.

Data and Artificial Intelligence Technologies

Extracting different types of data such as tracking crowds, traffic congestion levels, street and road conditions, environmental conditions, and many others, as these data are processed with artificial intelligence techniques to reach solutions that support decision-makers.

Open Challenges and Sophisticated-Related Issues

The Hajj and Umrah system abounds with many open issues that need further professional scientific research. Accordingly, the most important open research issues are provided here, hoping to motivate the studies to be carried out relatively in the near future, as topics outlined next.

Security and Privacy

Very limited research has been observed in the area of technology security [131] and privacy [132] within the Hajj and Umrah E-Systems. This issue should be addressed in future studies of several topics, including social media [133], Language-related researches [134], smart cloud computing [135], IoT [136], healthcare information [137], medical assistances [138], data mining [139], and data communication [140].

Big Data and IoT

Big data and the IoT are promising research issues in the Hajj and Umrah system as they can be used to enhance data-based decision-making in many different areas [136], including business, social behavior, social services, healthcare, psychology, security, and much more [133]. Many researchers have proposed several frameworks to make use of big data as effectively as possible [27, 66, 79, 80]. However, more research is still needed that addresses the benefits of big data and IoT considering the challenges of reliability and security [137].

Virtual and Augmented Reality

Some researchers have studied the use of virtual reality and augmented reality technology [55-61]. However, there is a need to study the possibility of expanding the use of this technology and study its impact on the beneficiaries of Hajj and Umrah performers.

Sentiment Analysis

Sentiment analysis is a process used to identify and categorize the opinions or feelings that come from users, whether they are found in texts (such as tweets, comments, or reviews) or images and videos (such as emojis or stickers) [19]. Recently, there are many studies that have addressed this issue using different techniques such as deep learning-based algorithms [141], and facial expression machine learning [142] as well as lexicon-based algorithms [143, 144]. Other studies have focused on capturing emotional and discriminative features from image and text content [145] and attention-based modality-gated networks for image-text sentiment analysis [146]. Likewise, this open issue lacks studies that attempt to analyze users' sentiments about issues related to the Hajj and Umrah system. Moreover, more research efforts should be made to study the performance [147], accuracy [148], and reliability [149] of sentiment analysis methods and their application to commonly used languages [150].

Delay Minimization in Network Communication

The people in the cities of Makkah and Madinah increases dramatically during the Hajj and Umrah seasons, as does their use of information technology and communication networks beside all IoT applications [122]. Hence, the quality of services provided over various communication networks is adversely affected [151]. There are some studies that have dealt with this issue in the literature such as the deployment framework discussion of fog computing during hajj [77] and smart crowd management via wireless and mobile technologies [123] as well as the framework remarks of secure mobile computing [78] and arithmetic hardware speeds analysis [152]. However, this delay minimization issue needs to be further considered in future research as it has not been sufficiently studied and explored from current integrated IoT smartness in terms of transmission cost [12], energy consumption [130], data transmission delay [152], security [3], reliability [4], scalability [153], computing efficiency [154].

Conclusion

This research presented an analytical study for the technologies and their applications in the Hajj and Umrah system during the last five years (2016–2020). The studied papers have been classified into four main branches, including studies of the two holy mosques and the holy sites, the pre-arrival studies, housing and services studies, and the transportation and crowd management studies. The results of the analysis showed that most of the reviewed researches were in 2018, with a rate of 34.2%. Also, the field of artificial intelligence was the most targeted area by researchers with 24.2%. Moreover, the results showed that real implementation was the most used tool among researchers as ratioed at 42.3%, followed by framework analysis at 20.2%. Furthermore, the results revealed that the majority of researchers relied on the use of descriptive statistics in their data analysis and interpretation, at a rate of 73.5%. Additionally, the most data collection method used by researchers is based on the use of official reports and observations with a rate of 24.8%, as they are very clear and fixed, followed by virtual data and software/technical equipment/ cameras tools at 18.8% each. At end, the results illustrated a relatively weak research studies and citation regarding the two holy mosques and holy sites as compared to other research branches. Finally, this research was concluded with some research ideas and practical suggestions that can be applied in the two holy mosques and the holy sites to serve pilgrims, Umrah performers, visitors and those who provide services to them. For future work examples, it is recommended to do research on helping Hajj and Umrah decision-makers by involving IoT smart devices using NFC as well as optimizing surveillance systems for abnormal activities. Also, many research studies can be performed to apply innovative smart parking schemes for vehicle arrangements and cluster hierarchy and smart buildings techniques for human grouping and interaction activities. It is believed that this research is just building the fundamental background for coming IoT technology research to come improving Hajj and Umrah world class services.