| Literature DB >> 30261665 |
Marcin Bernas1, Bartłomiej Płaczek2, Wojciech Korski3, Piotr Loska4, Jarosław Smyła5, Piotr Szymała6.
Abstract
This paper reviews low-cost vehicle and pedestrian detection methods and compares their accuracy. The main goal of this survey is to summarize the progress achieved to date and to help identify the sensing technologies that provide high detection accuracy and meet requirements related to cost and ease of installation. Special attention is paid to wireless battery-powered detectors of small dimensions that can be quickly and effortlessly installed alongside traffic lanes (on the side of a road or on a curb) without any additional supporting structures. The comparison of detection methods presented in this paper is based on results of experiments that were conducted with a variety of sensors in a wide range of configurations. During experiments various sensor sets were analyzed. It was shown that the detection accuracy can be significantly improved by fusing data from appropriately selected set of sensors. The experimental results reveal that accurate vehicle detection can be achieved by using sets of passive sensors. Application of active sensors was necessary to obtain satisfactory results in case of pedestrian detection.Entities:
Keywords: intelligent transport systems; low-cost sensors; machine learning; pedestrian detection; sensor fusion; vehicle detection
Year: 2018 PMID: 30261665 PMCID: PMC6210350 DOI: 10.3390/s18103243
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.576
Usefulness of sensing technologies.
| Sensing Technology | Principle of Operation | Requirements | |||
|---|---|---|---|---|---|
| Cost | Small Dimensions | Energy Consumption | Easy to Install | ||
| Inductive loops | Inductance measurement | Low | No | High | No |
| Cameras | Image analysis | High | Yes | High | Yes |
| Magnetometers | Magnetic field measurement | Low | Yes | Low | Yes |
| Acoustic sensors | Acoustic pressure measurement | Medium | Yes | Low | Yes |
| Radars/LIDARs | Detection of reflected electromagnetic wave | High | No | High | Yes |
| Accelerometers | Vibration measurement | Medium | Yes | Low | Yes |
| Light sensors | Light intensity measurement | Low | Yes | Low | Yes |
| Passive infrared sensors | Infrared radiation measurement | Medium | Yes | Low | Yes |
| Ultrasonic sensors | Detection of reflected sound wave | Low | No | Medium | Yes |
| Wireless communication devices | Measurement of received signal strength | Low | Yes | Medium | Yes |
Representative works related to low-cost traffic monitoring methods.
| Study | Application | Data Source | Description | Important Findings | Comments |
|---|---|---|---|---|---|
| Mao et al., 2013 [ | Object tracking | Wireless network with 40 light sensors | Trajectories and speeds of moving persons were estimated in indoor environment | Light sensor is sensitive to change of the light level in the environment even if multiple light sources are present. | Energy consumption is high as dedicated light sources are necessary. |
| Roy et al., 2011 [ | Detection of road congestion | Wireless transmitter -receiver pair | Free-flowing and congested traffic states were recognized based on signal strength, link quality and packet reception metrics | Accuracy does not depend on transmitter power. Low accuracy is obtained when transmitter -receiver distance is short (<20 m). | Individual vehicles were not detected. Low-cost, energy efficient ZigBee modules were implemented. |
| Horvat et al., 2012 [ | Detection of vehicles | Wireless transmitter -receiver pair | The possibility of detecting vehicles based on RSSI measurements was demonstrated | Pass of a vehicle causes drop of RSSI value. Gradient of the RSSI drop depends on vehicle velocity. | Accuracy of vehicle detection was not evaluated. Low-cost, energy efficient ZigBee modules were implemented. |
| Kassem et al., 2012 [ | Vehicle detection and speed estimation | Wireless network with 2 transmitters and 2 receivers | Stopped and moving cars were recognized based on mean and variance of RSSI. Relation between RSSI variance and vehicle speed was used for speed estimation. | Presence of a vehicle affects mean of RSSI. The change of RSSI can be negative or positive. Variance of RSSI decreases when vehicle speed increases. | High accuracy of vehicle detection was achieved using a small dataset of 20 vehicles. WiFi devices were implemented that have high energy consumption. |
| Won et al., 2017 [ | Vehicle detection, classification, speed estimation, and lane recognition | Wireless transmitter -receiver pair | CSI data were used to detect vehicles, categorize them as cars or trucks, estimate their speeds and recognize traffic lane. | Number of CSI samples collected while a vehicle passes between transmitter and receiver can be used for estimation of vehicle speed.Vehicles on different lanes exhibit distinct CSI distributions. | A large dataset was used for experiments (400 vehicles).WiFi devices were implemented that have high energy consumption. |
| Haferkamp et al., 2017 [ | Vehicle detection and classification | Wireless network with 3 transmitters and 3 receivers | RSSI data were used to detected vehicles and categorize them as cars or trucks. | Ray tracing simulations are helpful in classifier training and optimization of antenna parameters. | High classification accuracy was achieved for a large test dataset.The use of directional antennas increases hardware cost. |
| Bernas et al., 2018 [ | Vehicle detection and classification | Wireless network with 4 transmitters and 4 receivers | RSSI data were used to detected vehicles and categorize them as cars, semi trucks or trucks | Dependency exists between height at which devices are installed and the ability to detect particular vehicle class. | High classification accuracy and low energy consumption were achieved by using Bluetooth low energy modules. |
| Mrazovac et al., 2013 [ | Human detection | Wireless network with 4 transceivers | Human presence was detected based on frequency analysis of RSSI variations. | Human presence can be detected and distinguished from background update via analysis of RSSI variations. | Experiments were conducted in indoor environment. |
| Hostettler et al., 2011 [ | Vehicle detection | Accelerometer | Passing vehicles were detected in simulated and real-world scenarios | Adaptive threshold detection algorithm enables accurate vehicle detection based on road vibration measurements. | High accuracy was achieved using real traffic data for 142 vehicles. False detections can occur, e.g., due to nearby construction work. |
| Hostettler et al., 2012 [ | Estimation of vehicle speed, wheelbase, and distance from road edge | Accelerometer | Speed of vehicle, its wheelbase, and distance from road edge was estimated by using extended Kalman filter. | Road surface vibrationsmeasured by single accelerometer can be used to track vehicles moving along a straight road. | The results are presented for two specific car models. Small dataset was used for testing. A number of parameters have to be predetermined. |
| Ma et al., 2014 [ | Vehicle classification | Wireless sensor network with 6 accelerometers and 3 magnetometers | Vehicles were categorized into 3 classes based on axle count and spacing. | Accelerometers can be used for detecting axle locations. Magnetometers enable estimating vehicle speed and recognizing gaps between vehicles. | Sensors are installed in surface of traffic lane. Tire has to roll directly on top of at least one accelerometer. Short battery lifetime. |
| Rivas et al., 2017 [ | Vehicle detection, recognition of driving direction, speed estimation | Sensor network with 4 accelerometers | Vehicles were detected with accuracy of 80%. Travel direction was recognized with 90% accuracy. Average speed measurement error was of 27% | Frequency range of street vibrations is between 250 Hz and 400 Hz. Sensors must have a range at least of 1 kHz. | Sensors mounted on roadside. Disadvantages are large size and high cost of sensors (>1000€ per unit). False detections are caused by bicycles. |
| Ghosh et al., 2015 [ | Vehicle detection | Geophone and seismometer | Vehicles were detected in different scenarios: single vehicle moving, multiple vehicle moving, person walking and running nearby sensor. | The method is suitable for vehicle detection in domain of defense and perimeter monitoring. | The experiments were conducted for three types of vehicles: bus, tractor and truck. Personal cars were not considered. |
| Taghvaeeyan et al., 2014 [ | Vehicle counting, classification, speed estimation | Four anisotropic magnetoresistive sensors | 188 vehicles were detected and classified. Additionally, speed was estimated and right turns were recognized at intersection. | Speed of vehicle can be estimated based on cross-correlation between signals from two sensors. Classification can be performed based on magnetic length and magnetic height of vehicles. | Four vehicle classes were considered. Sensors are placed on road side. Precise time synchronization of sensors is required. |
| Balid et al., 2016 [ | Vehicle detection and speed estimation | Wireless sensor network with two magnetometers | One sensor was used for vehicle detection.Speed was calculated based on travel time between twolongitudinally positioned sensor nodes | Variations of magnetic flux for sensors on road side are relativelyuniform when compared to sensors in traffic lane, which accounts for slightly better accuracy. | The system can be installed on surface of traffic lane or on road side.GPS modules were used for time synchronization. |
| Jo et al., 2014 [ | Vehicle detection | Ultrasonic sensor | Single sensor was installed on road side to detect vehicles in two-lane road. | Ultrasonic sensors should only be used on roads with few lanes and moderate traffic volume. | Vehicle detection across multiple lanes with a single roadside ultrasonic sensor suffers a reduction in detection accuracy under dense traffic flow. |
| Volling 2013 [ | Bicycle detection | Microwave radar | Tests with a small bicycle have confirmed high accuracy of the detection. | Simple analysis of sensor readings enables differentiating bicycles from vehicles. | Radar has to be installed in surface of the road. |
| Barbagli et al., 2011 [ | Vehicle detection and speed estimation | Pair of microphones | Prototype was tested on a motorway. The collected data include vehicle counts and average speeds. | For vehicle speed above 30 km/h, the dominant sound sources are tires. For stopped vehicles, the dominant soundis motor noise. This fact can be used for traffic jam detection. | Sensor node is installed on the motorway’s guardrail and powered by rechargeable battery assisted by solar panel. |
| George et al., 2013 [ | Vehicle detection and classification | Pair of microphones | Vehicles were detected based on peaks of low pass filtered acoustic energy. Neural network was used to categorize vehicles into 4 classes. | A peak finding algorithm for vehicles detection was proposed. Mel-frequency cepstral coefficients are useful for audio-based vehicle classification. | Low classification accuracy was achieved (67%). Multilane traffic was not considered. Impact of acceleration and gear shift on classification needs further exploration. |
| Na et al., 2015 [ | Vehicle detection, classification, speed estimation, and lane recognition. | Array of 37 microphones | Vehicles were detected in 3 traffic lanes of a highway. Two vehicle classes were recognized based on time taken to pass detection zone. | Acceptable accuracy of vehicle countingand speed estimation can be achieved. High error rate was encountered for lane occupancy calculation and vehicle classification. | Microphone array has large dimensions and requires supporting structures. |
Advantages and limitations of low-cost sensing technologies for road traffic monitoring.
| Sensing Technology | Advantages | Limitations |
|---|---|---|
| Infrared and visible light sensors |
monitoring of multiple traffic lanes is possible enable pedestrian and bicycle detection detection range is wide |
sensitive to light and weather variations cleaning is necessary |
| Signal strength analysis in wireless communication networks |
robust against light and weather variations additional information can be transmitted monitoring of multiple traffic lanes is possible |
devices have to be installed on both sides of the road, above road surface interference in ISM bands |
| Accelerometer applications |
robust against light and weather variations enables wheelbase detection and counting |
objects are not detected while not moving sensitive to vibrations in the environment |
| Magnetometer applications |
robust against light and weather variations |
sensor has to be installed inside or close to traffic lane unable to detect pedestrians/bicycles |
| Ultrasonic and microwave radars |
robust against light and weather variations monitoring of multiple traffic lanes is possible provide speed information enable pedestrian and bicycle detection |
wave-reflecting object has to be present on opposite side of the road Doppler sensors do not detect stopped objects |
| Acoustic sensing |
robust against light and weather variations monitoring of multiple traffic lanes is possible |
complex computations are necessary to eliminate impact of other sound sources |
Figure 1First model of sensor node (SN1): (a) smartphone attached to aluminum plate; (b) placement of the device during experiments.
Built-in sensors of SN1.
| Sensor Type | Producer | Model | Sensitivity | Range |
|---|---|---|---|---|
| Accelerometer/gyroscope | Bosch | BMI160 | 16384 LBS/g | +/−2 g |
| Magnetometer | Yamaha | YAS537 | 0.3 μT | 2000 μT |
| Light sensor | Liteon | LTR55X | 0.6 lux | 10,000 lux |
| Microphone | Xiaomi | - | - | 40 Hz–48 kHz |
| Bluetooth module 1 | Xiaomi | BLE 4.1 | - | −100–0 dBm |
1 used for measurement of RSSI.
Figure 2Second model of sensor node (SN2): (1) curb, (2) main box with microcontroller and sensors, (3) ultrasonic sensor, (4) Doppler radar, (5) LIDAR, infrared sensor, and infrared camera, (6) accelerometers, (7) aluminum profile glued to the road surface.
Sensors installed in SN2.
| Model | Sensor Type | EnergyConsumption | Precision | Comments |
|---|---|---|---|---|
| SEN0158 | Infrared camera | 44 mA | Range 0–3 m | |
| DFR0052 | Piezoelectric vibration sensor | 0 | - | - |
| SEN-14032 | LIDAR | 130 mA | +/−25 cm | Range 0–40 m |
| GP2Y0A710K0F | Infrared distance measuring sensor | 30 mA | - | Range 1–5.5 m |
| LOGO Sensor | Accelerometer | B/D | - | - |
| SEN-09198 | Piezoelectric vibration sensor | 0 | +/−1% | - |
| MLX90614ESF | Infrared sensor | 1 mA | +/−0.5 °C | - |
| 7644 HB100 | Microwave Doppler radar | 30 mA | - | Range up to 20 m |
| 7181 BH-1750 | Light sensor | 120 μA | 20% | - |
| SEN0171 | Passive infrared sensor | 15 μA | - | 7 m |
| BMP280 | Barometer | 2.7 μA | ±0.12 hPa | - |
| HMC5883L | Magnetometer | 100 μA | 1° | - |
| ISL29125 | Light sensor | 56 μA | 300 lux | - |
| LSM9DS1 | Magnetometer, accelerometer, gyroscope | 600 μA | 1.13% | - |
| SEN0192 | Microwave doppler radar | 37 mA | - | - |
| HC-SR501 | Passive infrared sensor | 65 mA | - | - |
| JSN-SR04T | Ultrasonic distance sensor | 30 mA | 1 cm. | - |
| ADXL355Z | MEMS accelerometer | 138 μA | ±2 g–±8 g | - |
Figure 3Housing of Microwave Doppler radar HB100.
Figure 4Housing of light sensor: (1) hole with diameter 3 mm, (2) sensor ISL2915.
Figure 5Schema of vehicle localization experiments.
Accuracy of object detection based on individual sensor readings from SN1.
| Sensor Reading | Object Detection Accuracy (%) | ||
|---|---|---|---|
| Vehicle | Pedestrian (Walk) | Pedestrian (Run) | |
| Accelerometer x | 46 | 64 | 49 |
| Accelerometer y | 46 | 63 | 57 |
| Accelerometer z | 58 | 58 | 57 |
| Gyroscope x | 40 | 53 | 70 |
| Gyroscope y | 44 | 49 | 59 |
| Gyroscope z | 49 | 49 | 34 |
| Magnetometer x | 93 | 49 | 52 |
| Magnetometer y | 61 | 47 | 52 |
| Magnetometer z | 83 | 42 | 48 |
| Microphone | 95 | 89 | 97 |
| Light sensor | 60 | 79 | 57 |
| RSSI | 85 | 42 | 43 |
Figure 6Comparison of measurements collected by SN1 for vehicle presence and absence.
Figure 7Comparison measurements collected by SN1 for pedestrian presence and absence.
Figure 8Sound spectra for vehicles of different classes and for background noise.
Accuracy of vehicle detection based on combined sensor readings from SN1.
| Dataset | Algorithm | Aggregates | Vehicle Detection Accuracy (%) |
|---|---|---|---|
| Full | DT | average, standard deviation | 100 |
| median, minimum, maximum | 100 | ||
| KNN | average, standard deviation | 100 | |
| median, minimum, maximum | 100 | ||
| MLP | average, standard deviation | 92 | |
| median, minimum, maximum | 77 | ||
| Without sound | DT | average, standard deviation | 88 |
| median, minimum, maximum | 85 | ||
| KNN | average, standard deviation | 94 | |
| median, minimum, maximum | 94 | ||
| MLP | average, standard deviation | 82 | |
| median, minimum, maximum | 85 |
Accuracy of object detection based on individual sensors in SN2.
| Sensor | Detection Accuracy (%) | Comments | |
|---|---|---|---|
| Vehicle | Pedestrian | ||
| Accelerometer | 60 | 64 | Enables detection of heavy vehicles. Needs to be bonded to road surface. |
| Magnetometer | 93 | 49 | Detects vehicles in range of 2 m. Does not efficiently detect pedestrians. |
| Light sensor | 60–95 | 60–85 | Detects objects in range of 4 m. Sensitive to ambient lighting conditions and sensor orientation. |
| Passive infrared sensor | 39 | 69 | Low detection accuracy for both vehicles and pedestrians. Detection range limited to 1 m. |
| Infrared distance measuring sensor | 80 | 76 | Detection range up to 5 m. The object must cut the narrow beam otherwise will not be detected. |
| LIDAR | 83 | 78 | Detection range up to 5 m. |
| Piezoelectric vibration sensor | 50 | 50 | Low detection accuracy for both vehicles and pedestrians. |
| Barometer | 52 | 50 | Low detection accuracy for both vehicles and pedestrians. Detection range limited to 50cm. |
| Microwave Doppler radar (SEN0192) | 76 | 69 | Directed perpendicular to road axis. Detection range up to 5 m. |
| Microwave Doppler radar(7644 HB100) without housing | 41 | 44 | Oriented 45 degrees to road axis. Difficult to tune and configure. |
| Microwave Doppler radar(7644 HB100) with housing | 81 | 79 | Installed 2 m above a road/sidewalk. |
Figure 9Readings of magnetometer for various distances between vehicle and sensor.
Figure 10Readings of light sensor.
Accuracy of vehicle detection and localization based on combined sensor readings from SN2.
| Sensors | Accuracy (%) | |
|---|---|---|
| Localization | Detection | |
|
| ||
| accelerometer, light sensor, vibration sensor, magnetometer, PIR, barometer | 64 | 98 |
| magnetometer, light sensor | 69 | 98 |
| accelerometer, vibration sensor, magnetometer, PIR, barometer | 68 | 98 |
| accelerometer, vibration sensor, magnetometer, PIR | 68 | 98 |
| accelerometer, vibration sensor, magnetometer | 72 | 97 |
| accelerometer, magnetometer, light sensor | 71 | 98 |
|
| ||
| ultrasonic sensor, microwave radar, LIDAR, infrared camera | 57 | 97 |
| microwave radar, LIDAR, infrared camera | 58 | 97 |
| ultrasonic sensor, microwave radar, LIDAR | 49 | 97 |
|
| ||
| accelerometer, vibration sensor, magnetometer, microwave radar | 73 | 98 |
Accuracy of pedestrian detection and localization based on combined sensor readings from SN2.
| Sensors | Accuracy (%) | |
|---|---|---|
| Localization | Detection | |
|
| ||
| accelerometer, light sensor, vibration sensor, magnetometer, PIR, barometer | 58 | 84 |
| accelerometer, light sensor, PIR | 59 | 89 |
| light sensor, PIR | 60 | 88 |
|
| ||
| ultrasonic sensor, microwave radar, LIDAR, infrared camera | 45 | 94 |
| ultrasonic sensor, microwave radar, LIDAR | 45 | 94 |
| microwave radar, LIDAR | 49 | 95 |
|
| ||
| microwave radar, LIDAR, light sensor, PIR | 66 | 95 |