| Literature DB >> 31130644 |
Tiago M Fernández-Caramés1, Oscar Blanco-Novoa2, Iván Froiz-Míguez3, Paula Fraga-Lamas4.
Abstract
Industry 4.0 has paved the way for a world where smart factories will automate and upgrade many processes through the use of some of the latest emerging technologies. One of such technologies is Unmanned Aerial Vehicles (UAVs), which have evolved a great deal in the last years in terms of technology (e.g., control units, sensors, UAV frames) and have significantlyr educed their cost. UAVs can help industry in automatable and tedious tasks, like the ones performed on a regular basis for determining the inventory and for preserving item traceability. In such tasks, especially when it comes from untrusted third parties, it is essential to determine whether the collected information is valid or true. Likewise, ensuring data trustworthiness is a key issue in order to leverage Big Data analytics to supply chain efficiency and effectiveness. In such a case, blockchain, another Industry 4.0 technology that has become very popular in other fields like finance, has the potential to provide a higher level of transparency, security, trust and efficiency in the supply chain and enable the use of smart contracts. Thus, in this paper, we present the design and evaluation of a UAV-based system aimed at automating inventory tasks and keeping the traceability of industrial items attached to Radio-Frequency IDentification (RFID) tags. To confront current shortcomings, such a system is developed under a versatile, modular and scalable architecture aimed to reinforce cyber security and decentralization while fostering external audits and big data analytics. Therefore, the system uses a blockchain and a distributed ledger to store certain inventory data collected by UAVs, validate them, ensure their trustworthiness and make them available to the interested parties. In order to show the performance of the proposed system, different tests were performed in a real industrial warehouse, concluding that the system is able to obtain the inventory data really fast in comparison to traditional manual tasks, while being also able to estimate the position of the items when hovering over them thanks to their tag's signal strength. In addition, the performance of the proposed blockchain-based architecture was evaluated in different scenarios.Entities:
Keywords: DLT; IPFS; Industry 4.0; RFID; UAV; blockchain; drones; inventory; logistics; smart contracts; supply chain management; traceability
Year: 2019 PMID: 31130644 PMCID: PMC6566655 DOI: 10.3390/s19102394
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.576
Figure 1Technological evolution of identification tags.
Main characteristics of the most relevant communications and identification technologies for inventory and traceability applications.
| Technology | Frequency Band | Max. Range in Optimal Conditions | Data Rate | Power type | Main Features | Main Limitations for Inventory Applications | Popular Applications |
|---|---|---|---|---|---|---|---|
| ANT+ | 2.4 GHz | 30 m | 20 kbit/s | Ultra-low power | Up to 65,533 nodes | Lack of commercial inventory tags | Health, sport monitoring |
| Barcode/QR | − | <4 m | − | No power | Very low cost, visual decoding | Need for LOS | Asset tracking and marketing |
| Bluetooth 5 LE | 2.4 GHz | <400 m | 1360 kbit/s | Low power | Batteries only last days to weeks | Batteries need to be recharged, shared communications radio frequency | Beacons, wireless headsets |
| DASH7/ISO 18000-7 | 315–915 MHz | <10 km | 27.8 kbit/s | Very low power, alkaline batteries last months to years | Long reading distance, multi-year battery | Batteries need to be recharged, shared communications radio frequency | Smart industry and military |
| HF RFID | 3–30 MHz (13.56 MHz) | a few meters | <640 kbit/s | No power | NLOS, no need for batteries | Relatively short reading range | Smart Industry, payments, asset tracking |
| Infrared (IrDA) | 300 GHz to 430 THz | a few meters | 2.4 kbit/s–1 Gbit/s | Low power | Low-cost hardware, security, high speed | Need for LOS, batteries may drain fast when transmitting continuously | Remote control, data transfer |
| IQRF | 433 MHz, 868 MHz or 916 MHz | hundreds of meters | 19.2 kbit/s | Low power | Long communications range | Shared communications radio frequency | Internet of Things and M2M applications |
| LF RFID | 30–300 KHz (125 KHz) | <10 cm | <640 kbit/s | No power | NLOS, low cost | Very short reading distance (in general, a few centimeters) | Smart Industry and security access |
| NB-IoT | LTE in-band, guard-band | <35 km | <250 kbit/s | Low power | Long reading range | Dependent on third-party infrastructure | IoT applications |
| NFC | 13.56 MHz | <20 cm | 424 kbit/s | No power | Low cost | Short reading distance | Ticketing and payments |
| RuBee | 131 KHz | 20 m | 8 kbit/s | Very low power | Magnetic propagation, multi-year battery life | Only one known manufacturer | Applications with harsh electromagnetic propagation |
| LoRa/LoRaWAN | 2.4 GHz | kilometers | 0.25–50 kbit/s | Low power | Long range, long battery life | Very few commercial inventory tags, more expensive than other alternatives | Smart cities, M2M applications |
| SigFox | 868–902 MHz | 50 km | 100 kbit/s | Low power | Long range, global cellular network | Dependent on third-party infrastructure | Internet of Things and M2M applications |
| UHF RFID | 30 MHz–3 GHz | tens of meters | <640 kbit/s | Very low power or no power | NLOS, wide range of suppliers, low cost | Propagation problems with metal and liquids (specially with high transmission frequencies) | Smart Industry, asset tracking and toll payment |
| Ultrasounds | >20 kHz (2–10 MHz) | <10 m | 250 kbit/s | Low power | Based on sound wave propagation | Relatively short reading range | Asset positioning and location |
| UWB/IEEE 802.15.3a | 3.1 to 10.6 GHz | < 10 m | >110 Mbit/s | Low power (batteries last hours to days) | Accurate positioning (centimeter accuracy) | Expensive hardware, propagation problems in metallic environments | Real Time Location Systems (RTLS), short-distance streaming |
| Wi-Fi (IEEE 802.11b/g/n/ac) | 2.4–5 GHz | <150 m | up to 433 Mbit/s (one stream) | High power (batteries may last hours) | High speed, ubiquity | Short battery life | Internet access, broadband |
| Wi-Fi HaLow/IEEE 802.11ah | 868-915 MHz | <1 km | >100 Kbit/s per channel | Low power | Long communications range | Not compatible with previous Wi-Fi standards, shared communications radio frequency | IoT applications |
| WirelessHART | 2.4 GHz | <10 m | 250 kbit/s | Low power (Batteries last several years) | Compatibility with HART protocol, standardized as IEC 62591 | Shared communications radio frequency, lack of commercial inventory tags | Wireless sensor network applications |
| ZigBee | 868–915 MHz, 2.4 GHz | <100 m | 20–250 kbit/s | Very low power (batteries last months to years) | Easy to scale, up to 65,536 nodes | Relatively expensive hardware, potential interference from devices in the same frequency band | Smart Home and industrial applications |
Comparison of the main features of the most relevant UAV-based inventory systems and the proposed system.
| Reference | Type of Solution | Labelling and Identification Technology | UAV Characteristics | Designed Architecture and Communications | Main Inventory Function | Experiments and Key Performance Indicators (KPIs) | Advanced Supply Management Data Techniques | Blockchain or Any Other DLT |
|---|---|---|---|---|---|---|---|---|
| [ | Commercial solution by Hardis Group | Barcodes | Autonomous quadcopter with a high-performance scanning system and an HD camera. Battery life around 20 min (50 min to charge it). | It incorporates indoor localization technology. Automatic flight area and plan, 360 | Automate inventory-taking and inventory control in warehouses | No available KPI | Automatic acquisition of photo data. Cloud applications to manage mapping, data processing, reporting, and the fleet of drones. Compatible with all WMS and ERPS and managed by a tablet app. | No DLT |
| [ | Commercial solution, Geodis and delta drone | Barcodes | Autonomous quadcopter equipped with four HD cameras | Indoor geolocation technology, it operates autonomously during the hours the site is closed. | Plug and play solution, this solution also adapts to all types of Warehouse Management Systems (WMS) | Reading rates close to 100%. | Enables the counting and reporting of data in real time, the processing of data, and its restitution in the warehouse’s information system. | No DLT |
| [ | Commercial solution, Dron Scan | Barcodes | UAV equipped with a camera and a mounted display | DroneScan base station communicates via a dedicated RF frequency (not WiFi or Bluetooth) and has a range of over 100 m. | A Windows touch screen tablet allows the operator to receive live feedback both on screen and from audible cues as the drone scans and records data | 50 times faster than manual capturing | All aspects of the imported data are customizable by modifying scripts, the customisation changes the way the system works and how the scanned data are processed. DroneScan software uploads scanned data and drone position information to the cloud (Azure IoT), to the customer systems (web services, RFC’s API’s or BAPI’s) and exports the data to Excel. The imported data are used to re-build a virtual map of the warehouse so that the location of the drone can be determined. | No DLT |
| [ | Academic solution | RFID, multimodal tag detection. | Autonomous Micro Aerial Vehicles (MAVs), RFID reader and two high-resolution cameras | Fast fully autonomous navigation and control, including avoidance of static and dynamic obstacles in indoor and outdoor environments. | Robust self-localization solely based on an onboard LIDAR at high velocities (up to 7.8 m/s) | - | - | No DLT |
| [ | Academic solution | - | - | - | Endogenous risk management mechanism to improve supply chain’s operation efficiency | Theoretical pharmaceutical factory supply chain topology structure based on blockchain. | Confront supply chain endogenous risk avoiding the credit risk caused by the information asymmetry among the enterprises inside the supply chain, and the risk caused by incomplete information acquisition inside the supply chain. | Blockchain and smart contracts |
| [ | Academic solution | - | - | - | Autonomous economic system with UAV. | Although field trials were conducted with drones, no KPIs are available. | Architectural solution for organizing a business activity protocol for multi-agent systems. | Communication system between agents (DAOs) in a P2P network using Ethereum and smart contracts. |
| [ | Academic solution | QR | IR-based camera, no additional description | Computer vision techniques (region candidate detection, feature extraction, and SVM classification) for barcode detection and recognition in factory warehouses. | Drone-assisted inventory management with an efficient detection framework to determine the localizations of 2D barcodes to improve path planning and reduce power consumption | Experiment performance results of 2D barcode images. The proposed method demonstrates a precision of 98.08% and a recall of 98.27% within a fused feature ROC curve. | - | No DLT |
| [ | Academic solution, open-source code of the UWB hardware and MAC protocol software. | QR | - | Plug-and-play capabilities and minimal pre-existing infrastructure by combining two wireless technologies: sub-GHz for IoT-standardized long-range wireless communication backbone and UWB for localization. | A MAC protocol for an UWB localization system using battery-powered or energy harvesting operated anchors. | Experimental validation for two real-life scenarios: autonomous drone navigation in a warehouse mock-up and tracking of runners in sport halls.Theoretical evaluation of the design choices on overall system performance in terms of update rate, energy consumption, maximum communication range, localization accuracy and scalability. | - | No DLT |
| [ | Academic solution | RFID | Phantom 2 vision DJI (weight 1242 g, maximum speed 15 m/s and up to 700 m) | Drone with a Windows CE 5.0 portable PDA (AT-880) that acts as a UHF RFID reader moves around an open storage yard. | Inventory checking in an open stock yard | Prototype. No performance experiments. | A data collection program detects and saves the information of passive tags obtained by a portable PDA. After the flight, the gathered tag data is transferred to the inventory checking server and is compared with the inventory data stored in database and classified in to four inventory states: normality, location error, missing, unregistered. | No DLT |
| [ | Academic solution | RFID (EPC) | Draganfly commercial radio-controlled helicopters 82×82 cm, average flight time of 12 min | RFID readers attached to the simulated UAVs are assumed to have a 100% read-guarantee when EPC tags are within the reading range of the RFID reader. | Read the EPCs in the warehouse within the 12-min duration | Preliminary simulation results, three-dimensional graphical simulator framework has been designed using Microsoft XNA framework to represent a real warehouse | Coordinated distribution of the UAVs. Although six independent UAVs were deployed, they collectively failed to complete the task of finding all EPCs | No DLT |
| [ | Academic solution | Barcodes, AR markers | UAVs and UGVs with LIDARs | UAV and UGV work cooperatively using vision techniques. The UGV acts as a carrying platform and as an AR ground reference for the indoor flight of the UAV. While the UAV is used as the mobile scanner. | Novel indoor warehouse inventory scheme to improve automation as well as the diminution of time consumption and injuries risks. | Experimental setup is to validate the visual guidance of the UAV taking the UGV as a ground. UAV need to be equipped with sensors to avoid collision with the racks during the scanning process. | - | No DLT |
| [ | Academic solution | RFID | - | - | Physical Internet-based intelligent manufacturing shop floors | Experiments on logistics rules for optimizing the delivery time | Big data analytics framework that processes the information collected from an RFID-enabled shop floor | No DLT |
| Proposed system | Academic solution | RFID | Indoor/outdoor hexacopter designed from scratch as a trade-off between cost, modularity, payload capacity and robustness. | Modular and scalable UAV-architecture using WiFi infrastructure and ability to run decentralized applications. | Enable inventory and traceability applications focused on a holistic view at inventory levels across the supply chain and with external stakeholders | Prototype and performance experiments: inventory time in the warehouse under different circumstances, signal strength monitoring and performance of the implemented architecture (decentralized database and blockchain response latency) | Data distribution and enhanced cyber security (information integrity, tamper-proof data, ensured reliability and availability), efficient data storage and data versioning. | Decentralized database (OrbitDB) over InterPlanetary File System (IPFS) in a P2P network using Ethereum and smart contracts to automate certain processes. |
Figure 2Proposed communications architecture.
Figure 3UAV used for the inventory and traceability system.
Main features of the UAV components.
| Components | Relevant Features |
|---|---|
| Flight controllers | Pixhawk 2.4.8 |
| STM32F427 microcontroller | |
| STM32F103 coprocessor | |
| Sensors | L3GD20 3-axis digital gyroscope |
| LSM303D 3-axis accelerometer and magnetometer | |
| MPU6000 6-axis accelerometer and magnetometer | |
| MS5607 barometer | |
| GPS M8N | |
| RFID reading system | NPR Active Track-2 |
| OrangePI PC Plus (SBC) | |
| Additional components | Frame with six arms (550 mm of wingspan) |
| Brushless motors 920 Kv | |
| ESCs Simonk 30 A | |
| Propellers: 10 inch-diameter and 45 inch-pitch | |
| Battery: 5 Ah (capacity) and 45 c-rate (discharge rate) |
Figure 4Implemented architecture.
Figure 5Inventory data insertion process and implemented architecture.
Figure 6Inventory data verification process.
Figure 7Warehouse where the experiments were performed.
Figure 8Warehouse material diversity.
Figure 9Ground station setup.
Figure 10One of the instants during the inventory tests.
Figure 11Percentage of read tags during four inventory flights.
Example of the collected inventory data.
| # Read Tags | % Read Tags | Timestamp (HH:MM:SS,ms) | New Read Tag ID |
|---|---|---|---|
| 0 | 0 | 18:14:43,087 (Take-off time) | |
| 1 | 7.692307692 | 18:14:46,058 | LOCATE00380349 |
| 2 | 15.38461538 | 18:14:46,090 | RFCBDG00011185 |
| 3 | 23.07692308 | 18:14:48,558 | LOCATE00380364 |
| 4 | 30.76923077 | 18:14:48,589 | RFCBDG00011185 |
| 5 | 38.46153846 | 18:14:52,748 | LOCATE00380372 |
| 6 | 46.15384615 | 18:14:54,349 | LOCATE00380349 |
| 7 | 53.84615385 | 18:14:57,129 | RFCBDG00011188 |
| 8 | 61.53846154 | 18:15:11,403 | LOCATE00380330 |
| 9 | 69.23076923 | 18:15:33,008 | LOCATE00365573 |
| 10 | 76.92307692 | 18:15:49,288 | LOCATE00375358 |
| 11 | 84.61538462 | 18:15:56,454 | LOCATE00380359 |
| 12 | 92.30769231 | 18:15:56,456 | LOCATE00380357 |
| 13 | 100 | 18:16:01,630 | LOCATE00375356 |
Figure 12SSI evolution of a tag during an inventory flight.
Mean and variance of the use cases considered in the OrbitDB performance test.
| # Tag IDs/Network | Intranet | Internet |
|---|---|---|
| 13 | Scenario A: | Scenario D: |
| 5000 | Scenario B: | Scenario E: |
| 10,000 | Scenario C: | Scenario F: |
Figure 13Response time in OrbitDB for (A) Scenario A, (B) Scenario B and (C) Scenario C.
Figure 14Response time in OrbitDB for (A) Scenario D, (B) Scenario E and (C) Scenario F.
Figure 15Probability Density Function (pdf) in OrbitDB for (A) Scenario A, (B) Scenario B and (C) Scenario C.
Figure 16Probability Density Function (pdf) in OrbitDB for (A) Scenario D, (B) Scenario E and (C) Scenario F.
Figure 17Ropsten testnet time response.
Figure 18Caption of Ropsten Testnet transactions.