Increasing demand for rail transportation results in denser and more high-speed usage of the existing railway network, making new and more advanced vehicle safety systems necessary. Furthermore, high traveling speeds and the large weights of trains lead to long braking distances-all of which necessitates a Long-Range Obstacle Detection (LROD) system, capable of detecting humans and other objects more than 1000 m in advance. According to current research, only a few sensor modalities are capable of reaching this far and recording sufficiently accurate data to distinguish individual objects. The limitation of these sensors, such as a 1D-Light Detection and Ranging (LiDAR), is however a very narrow Field of View (FoV), making it necessary to use high-precision means of orienting to target them at possible areas of interest. To close this research gap, this paper presents a high-precision pointing mechanism, for the use in a future novel railway obstacle detection system, capable of targeting a 1D-LiDAR at humans or objects at the required distance. This approach addresses the challenges of a low target price, restricted access to high-precision machinery and equipment as well as unique requirements of our target application. By combining established elements from 3D printers and Computer Numerical Control (CNC) machines with a double-hinged lever system, simple and low-cost components are capable of precisely orienting an arbitrary sensor platform. The system's actual pointing accuracy has been evaluated using a controlled, in-door, long-range experiment. The device was able to demonstrate a precision of 6.179 mdeg, which is at the limit of the measurable precision of the designed experiment.
Increasing demand for rail transportation results in denser and more high-speed usage of the existing railway network, making new and more advanced vehicle safety systems necessary. Furthermore, high traveling speeds and the large weights of trains lead to long braking distances-all of which necessitates a Long-Range Obstacle Detection (LROD) system, capable of detecting humans and other objects more than 1000 m in advance. According to current research, only a few sensor modalities are capable of reaching this far and recording sufficiently accurate data to distinguish individual objects. The limitation of these sensors, such as a 1D-Light Detection and Ranging (LiDAR), is however a very narrow Field of View (FoV), making it necessary to use high-precision means of orienting to target them at possible areas of interest. To close this research gap, this paper presents a high-precision pointing mechanism, for the use in a future novel railway obstacle detection system, capable of targeting a 1D-LiDAR at humans or objects at the required distance. This approach addresses the challenges of a low target price, restricted access to high-precision machinery and equipment as well as unique requirements of our target application. By combining established elements from 3D printers and Computer Numerical Control (CNC) machines with a double-hinged lever system, simple and low-cost components are capable of precisely orienting an arbitrary sensor platform. The system's actual pointing accuracy has been evaluated using a controlled, in-door, long-range experiment. The device was able to demonstrate a precision of 6.179 mdeg, which is at the limit of the measurable precision of the designed experiment.
Entities:
Keywords:
high precision actuation; long-range obstacle detection; pointing mechanism
Existing railway networks are reaching their operational capacities due to rising global demand for rail transportation. Reasons for this include increasing international trade and changing consumer behavior due to raising environmental awareness and changes in personal mobility needs. Consequently, upgrades to the existing modes of operation and railway control systems, in the form of safer, more reliable, and more efficient trains, are required to keep up with the current growth. More precisely, new railway operation modes require not only reliable communication between rail vehicles, and continuous, accurate and robust localization (European Train Control System (ETCS) Level 0–2 [1]) of each train, but also environmental awareness in the form of Long-Range Obstacle Detection (LROD). In particular, the early detection of humans, animals, or objects on, or in the vicinity of the railway tracks can not only prevent life-threatening risks to humans but also extensive disruptions to the operation of the railway network. However, due to the high weight and velocity of rail vehicles, and the lower traction limiting the braking force, long distances are required for safe braking [2]. Given these circumstances, obstacle detection systems need to be capable of reliably detecting and positioning possible dangers at long ranges, greater than 1000 m.Several technologies and solutions are already in use for obstacle detection in different applications, for example, in the automotive industry. However, there are several limitations to all of them restricting their direct transferability to the railway domain, as shown in Figure 1. The visualization highlights the long-range requirements for the application in railway systems in comparison to the capabilities of different sensor modalities, such as stereo vision and Light Detection and Ranging (LiDAR). Two additional solutions for detecting humans and other objects, even in challenging situations, are color and thermal cameras [3]. However, the lack of range information makes it difficult to accurately locate the detected obstacle, reducing the system’s reliability. Data driven methods can aid in providing vision based depth information at impressive ranges, but are highly dependent on training data. Stereo camera setups can provide additional depth information to the system [4] by computing the binocular disparity of an object which is observed by both cameras. As the depth resolution is dependent on the stereo baseline (the distance between the two cameras), a baseline larger than the width of the train would be required to achieve accurate enough depth measurements to be reliable for the obstacle detection process.
Figure 1
Sensing range of a variety of sensors commonly used for obstacle detection and autonomous vehicles. Furthermore, braking distances at various velocities are shown. The Field of View (FoV) of the individual sensors is highlighted through their color, ranging from super wide FoVs (green) to single point measurements (red).
Additionally, radar sensors are already in use for automotive driver assistance systems and can achieve measurement ranges above 1000 m. As they rely though on the reflection of emitted radio waves from all target objects, they are limited to special radar reflective materials, such as metal, and sufficiently large targets, and are therefore not suited for detecting generic unknown obstacles at such distances.Currently available dense LiDAR sensors can sample their environment accurately enough for detecting objects, by emitting multiple beams of light and observing their reflections, but are typically limited to a range under 300 m. Sparse long-range LiDAR systems exist [5], though with reduced measurement density and increased measurement times, making them unsuitable for detecting objects while the sensor is moving at high speed.The limitations of the aforementioned sensor systems make it clear that, in order to achieve an accurate detection and localization of obstacles at long range, it is necessary to integrate various sensor modalities into a complete detection system.To address these limitations, we propose to develop a combined camera-LiDAR sensor system capable of providing accurate and reliable obstacle detection and positioning at large distances. The proposed system consists of a wide-angle overview camera observing the train’s entire FoV (the tracks and their immediate vicinity lying ahead of the train), as shown in green in Figure 2. Based on the vision system as well as a known track map, a possible Region of Interest (RoI) can be determined (shown in yellow) within which possible obstacles might be located. Additional cameras and LiDAR sensors are then supposed to detect these obstacles at high range within this RoI. 1D-LiDAR sensors exist with multiple kilometers of range. However, these sensors are only capable of measuring a few points per second and can therefore not detect objects on their own. Instead, we propose to couple such a sensor with a high focal length camera to produce an image with combined depth measurement. Due to the very limited FoV of this setup, as well as the long measurement time of the laser, an active vision approach is required. The system needs to be placed on a gimballing platform capable of orienting the combined sensor setup at possible targets located within the specified RoI. This is shown in the centre of Figure 2 where the FoVs of two sensors are actively being angled at the rail tracks ahead. As especially the FoV of the 1D-LiDAR is severely limited, it is crucial to be able to control the exact orientation of the setup in order to reliably hit targets with the laser beam, even at distances above 1000 m. The actuation system of such an active vision sensor setup is therefore the focus of this research work.
Figure 2
Long-Range Obstacle Detection systems need to focus their sensors on targeted Regions of Interest, shown in yellow and red (arrow), in the vicinity of the railway track. The change of attitude of individual sensors is shown in the centre image, to focus the sensors on possible obstacles. This can be done using a high precision pointing mechanism as shown on the right.
To realize this, our work consists of the development and evaluation of a novel pointing mechanism suitable to our target application. More precisely, the contributions of our development are the following:A novel, high precision, versatile, low-cost pointing mechanism.An evaluation of the pointing resolution and accuracy of the developed system, based on extensive indoor tests in a controlled environment using optical equipment, as well as a direct comparison to commercially available gimbals.An investigation into the remaining sources of errors, a thorough evaluation of their effects, and proposals for their future mitigation.A novel proposal for an integrated sensor solution to Long-Range Obstacle Detection, consisting of custom high-precision hardware and specialized sparse long-range sensors.The developed pointing mechanism could potentially be used for a variety of applications, ranging from active vision when combined with a camera, such as used in surveillance, astronomy, or cinematography, through measurement tasks, when combined with or Laser or Radar for example for Geomatics, or for communication systems where they orient antennas or lasers for long-range data transmission.For our target application of Long-Range Obstacle Detection for railway systems, it is important to reliably detect and localize objects at greater distance (>1 km) requiring an orienting system with sufficient precision and accuracy to hit a target using the 1D-LiDAR at these ranges. The major requirement to our developed system is therefore the pointing accuracy and precision. Precision here refers to the spread of the orientation error when aiming at a specific target. Accuracy on the other hand refers to how true the observed orientation of the gimbal is compared to its actual orientation. The average human width at shoulder height (bideltoid shoulder breadth) worldwide exceeds 400 mm for both men and women [6]. A pointing accuracy of at our target range of 1500 m should therefore be a minimum requirement. This translates to a maximum angular accuracy of 7.639 mdeg, rounded down to 7.5 mdeg.Further technical requirements to the developed system are a range of motion of at least 60 deg to cover the train’s FoV as well as a payload capability of 2 kg. An additional requirement to the overall project of developing this device is the low target price. This is limited to $1000, necessitating the development of a low-cost solution, utilizing mostly common and cheaply available components.The remainder of the paper is organized as follows: In Section 2, an extensive summary of related work in LROD and high-precision pointing mechanisms is provided. Furthermore, in Section 3, our system for precise pointing is described in detail. Experiments, results, evaluation, and a discussion thereof are given in Section 4 and a brief cost analysis in Section 5. Finally, Section 6 provides a conclusion with an outlook on future work.
2. Related Work
2.1. Railway Obstacle Detection
Long-Range Obstacle Detection for railway applications is an ongoing challenge and the focus of much ongoing research. Many approaches for purely vision-based object detection in the railway domain have been developed [7,8,9,10,11,12,13,14,15,16,17,18,19,20,21]. These typically employ machine learning and computer vision methods for object or anomaly detection or 3D-Vision methods for detecting physical intrusions into the vehicle’s path. However, most of these do not provide any in depth information. Some approaches employ machine learning or data-driven methods for depth estimation with reasonable success [22,23], even for distances over 500 m [24], but this is very much dependent on training data. Another approach is to deduce the distance based on the parallax of the tracks [25,26]. Ristić-Durrant et al. [3] provide an in-depth analysis of purely optical-based object detection systems for railways and compare their performances and limitations. Simple stereo camera setups can provide dense and accurate depth information, but due to the limited baseline only at a short range of approximately 80 m [4,27,28,29]Ukai [30] employs an active vision approach to extend the range of vision-based approaches. In further research, this is fused with Radar sensors for depth information [31,32]. However, the setup only has a depth estimation range of 200 m with a resolution of over 2.5 m on top of the limitations of Radar regarding target materials, limiting its usability for high-speed railway applications. Similarly, Radar is also fused with fixed cameras or stereo cameras [33].Several approaches employ thermal cameras as an easy means of detecting a variety of objects in the vicinity of the railway tracks [34,35]. These are especially beneficial in low-light situations or for detecting humans or animals due to their body heat. However, these approaches fail to detect obstacles that have the same temperature as their environment (e.g., fallen trees) and are also unable to provide any depth information. A combination of RGB and thermal cameras can provide more reliable object detections, especially in low light situations, but obtaining range information is still difficult, even when employing machine learning approaches [36].Ristić-Durrant et al. [37,38,39,40] have developed an advanced sensor setup, by combining a multi-baseline stereo camera setup with a thermal camera and a dense LiDAR scanner to detect objects on the tracks at ranges approaching the 1000 m mark. Fusing a simple camera and a LiDAR scanner [41,42,43,44,45] has shown promising results at ranges between 50 m and 300 m, depending on object sizes.
2.2. Long-Range Obstacle Detection
LROD has also been in development outside the railway industry. For example, it is used in the field of remote sensing, where simple vision-based object detection can be performed at a long range through the use of super-resolution cameras or super-resolution post-processing using deep learning [46]. In this case, challenges arise from the processing of the large, high-resolution images in a timely manner [47,48,49,50].Prior knowledge about the kind of objects that could be present in the camera’s field of view can significantly improve the long-range detection process, for example, for airplanes on a blue sky [51] or vehicles [52] on land.Due to their dense depth maps and comparatively cheap hardware setup, stereo cameras are one of the most commonly used methods for tracking objects and their depth. In several setups, ranges between 150 m [53] and 300 m [54,55,56,57] have been be achieved if the camera baseline is sufficiently large. Deep-learning based stereo vision approaches can improve the depth estimation results but are limited in increasing the maximum range [58,59,60].Detecting far-away objects in LiDAR is challenging, as the point clouds become sparse at long ranges and do not provide a sufficient amount of information to be able to distinguish individual objects.Fusing camera data with other sensor modalities can equally improve the LROD performance, but this is still limited to the range of either sensor. Various combinations have been tested, such as combining Stereo Vision and LiDAR [61,62] or Radar [63]. Special long-range LiDAR sensors are in development, but still, only rarely reach distances beyond 200 m [5].1D-LiDAR sensors can measure over much greater distances [64], reaching multiple kilometers. These sensors, however, do not provide enough data to be able to detect objects on their own and therefore need to be intelligently fused with other modalities and orienting mechanisms to provide satisfactory results.
2.3. Pointing Mechanisms
The various uses of pointing mechanisms and their specific requirements have led to the development of a multitude of possible orienting device designs and the respective selection of mechanisms, actuators, and sensors. The multitude of gimbal designs can be classified according to their mechanical setups, their type of actuators, their degrees of freedom or whether they orient the actual sensor, or just the optical path of the sensor setup, for example, through a mirror [65]. Most commonly, orienting devices are classified according to their mechanical setup into serial, parallel, or spherical mechanisms, as described in the following section.Serial Mechanisms: The most common design in commercial gimballing systems consists of a serial mechanism, which places rotary actuators at the joints, typically on orthogonal axes, to achieve the largest possible workspace, as seen in Figure 3a. The disadvantage of this design is a limited accuracy, as weight and therefore the load on individual joints adds up from stage to stage and errors accumulate. Approaches to creating high-precision serial gimbals are the utilization of high-precision components, such as actuators, bearings, and encoders, materials, and manufacturing techniques. This can result in high pointing accuracy, but also high manufacturing costs [66,67,68,69]. A common problem in such mechanical apertures is the backlash, which occurs when there are small gaps or clearances between mechanical parts, which lead to a loss of motion or no transfer of force from one part to the next. This, for example, is introduced, for example, by reduction gears [70], but can be compensated using springs [71] or flexure hinges [72]. A further mechanical analysis of joint clearance influences is done by Bai et al. [73]. However, these solutions typically result in more expensive manufacturing and higher required actuation forces.
Figure 3
Kinematic visualization of the most common pointing mechanism designs consisting either of (a) serial or (b,c) parallel mechanisms.
Instead of placing sensors directly on the orientation platform, mirrors can be placed there to only adjust the optical path of the sensors [74,75]. While this lowers required payload capacities and may allow for a larger range of motion, it introduces difficulties in controlling the system and promotes errors through sensor and axis misalignment [76] which need to be compensated for. Additionally, some sensor modalities, such as certain laser based devices, do not work using a mirror. Furthermore, different ways of actuation have been proposed either to save weight or to perform in particular environments, such as underwater. The use of pull-cables to actuate the different gimbal axis has been proposed multiple times [77,78], as well as the use of piezo-actuators for single Degrees of Freedom (DoF) gimbals [79]. However, the typical setup of two or three orthogonal axes has several shortcomings, such as singularities, gimbal-lock [80], and limited space for sensors, whose special designs aim to overcome, for example, through the use of more joints at non-orthogonal angles [81]. These solutions in turn have their own limitations, such as more mechanical joints, which due to their individual clearances may result in larger accumulated errors.Parallel Mechanisms: parallel variants have been developed in response to the numerous shortcomings of serial pointing mechanisms. In these, several joints and actuators are placed in parallel, resulting in more complex kinematics and control methods, but also the possibility to design specific dynamic capabilities of the system. One example of parallel mechanisms is the OmniWrist III [82], whose kinematics and control have been the focus of extensive research [83,84,85,86,87]. As the proposed application is a laser communication system [88], it has also been proposed to use Bragg Cells for precise beam steering [89,90,91], in combination with the OmniWrist III, to achieve high-precision and a high range of motion [92]. Another variation of these mechanisms places the sensor setup on a universal joint and attaches linear actuators to it either in the form of push rods [93,94,95,96,97] (Figure 3b), pulleys [98,99] or pneumatic muscles [100] to orient the platform.Flexural hinges, which connect rotary motors to the gimbal platform, can also provide beneficial dynamic properties in such a setup [101], while flexure hinges instead of a universal joint greatly benefit the system’s accuracy by limiting backlash [102,103]. Such a setup can also be extended to stereo vision, where both cameras need to be moved parallel to each other around their centers [104]. Gough–Stewart platforms (Figure 3c) and variations thereof feature more than the two or three DoFs required for a typical pointing mechanism but are equally often used for this purpose [105,106,107,108,109,110,111]. Piezo-actuators in the legs of this type of platform can provide high accuracy, but only a limited range of motion. The combination of multiple actuators in each leg can incorporate the advantages of both [112]. Furthermore, different leg designs for this platform approach, using a variety of actuators and featuring different kinematic characteristics [113,114,115,116,117,118,119,120,121], have been proposed, but few have actually been manufactured and tested [122]. Another possible improvement to the Gough–Stewart platform is the use of flexure hinges to reduce backlash and nonlinear friction [123]. Placing additional constraints on the system, for example, by fixing one of the joints, has also been suggested as a way to improve the controllability of the system [124].A special set of tip-tilt parallel mechanisms has been developed for the use in satellites, where a high-precision but low range of motion is required. These typically employ flexure hinges, as these provide no friction, backlash, or wear, and a high-accuracy actuation part, such as piezo-actuators [125,126,127], electromagnets [128,129,130] or servos [131]. However, the use of such flexure hinges can also lead to problems such as the distortion of the mirror surface at larger deflections [132]. Using a flexure ring instead of individual hinges attached to the mirror can compensate for this [133].Further variations on parallel gimbal platforms using various actuating arm designs include the use of three rotating legs to simulate the three DoF motion of human eyes [134], and installing flexure hinges on the actuating legs used to carry the large load of a rocket engine [135]. For underwater usage, it is beneficial to have all actuators in a single physical location to simplify the water-proofing process. To solve this issue, a specific 3DoF gimbal has been developed [136], featuring pan, tilt, and zoom motions, or similarly featuring only 2DoF [137]. Additionally, several more theoretical designs, which have not been tested, have been proposed and their dynamics analyzed [138,139,140,141,142].Parallel gimbal mechanisms are also often used in Micro-Electromechanical Systems (MEMS) applications [143] to tilt mirrors found in image projectors and LiDAR devices, though again with a very limited range of motion.Parallel gimbal designs offer the possibility of designing complex kinematic mechanisms for special target applications. However, these designs typically require a larger number of joints and their respective possibilities for backlash and special, expensive actuators, such as piezoelectric actuators or linear motors. Furthermore, their kinematics cannot be easily derived, making precise control mechanismsand active stabilization more complicated.Spherical Mechanisms: A niche group of pointing mechanisms consists of spherical mechanisms. For the use as an animatronic eye, spherical cameras can be suspended in a fluid and be actuated using electromagnets [144]. This allows a highly dynamic motion but does not feature precise pointing control. Special motor designs with multiple DoFs can also be used as spherical actuators. This can be achieved through special rotor/stator designs [145,146,147,148] or ultrasonic motors [149] but limits the available payload capacity, space for sensors and overall range of motion of the system.Even though a large variety of gimbal designs exists, most inaccuracies stem from the same sources. Fisk et al. [150] analyze possible sources of error, such as runout of bearings, non-orthogonality of axes, or the misalignment of other positioning sensors. Sweeney et al. [151] provide a set of general design rules for high-precision pointing mechanisms. These focus though on classical serial and parallel mechanisms and mainly focus on utilizing expensive and high-quality components.The gimbal developed as part of our research can be assigned to the category of serial gimbals, as one actuation stage is based on the other. Through the use of reduction gears and lever mechanisms, the actuator and encoder resolution can be down-stepped significantly, increasing both the system’s accuracy and precision. The separate mounting points for the payload carrying joints, independent of the actuators, partially isolate influences of backlash onto the orienting platform.A detailed overview of proposed gimballing mechanisms is given in Table 1. This table shows both commercially available orienting mechanisms and proposed mechanisms from the available literature.
Table 1
Overview of existing gimbal mechanisms from commercial suppliers and research. The individual specifications are compared with our requirements to highlight that no system can fulfill them within the specified price range. For many mechanisms, exact manufacturing costs are not known. Based on the depicted components, a rough price range is estimated as $–$$$. Most systems have different ranges of motion per axis. As pan is the most relevant axis to us, in those cases, only the pan range of motion is listed.
Resolution
Accuracy
Price
Range of Motion
DoF
Max Payload
Our requirements
7.5 mdeg
7.5 mdeg
$1k
±30deg
2
2 kg
Our solution (see Section 4)
0.559 mdeg
6.179 mdeg
$1k
±30deg
2
2 kg
DJI RS2 [152]
100 mdeg
20 mdeg
$1k
±180deg
3
4.5 kg
DJI Ronin 2 [153]
100 mdeg
20 mdeg
$8 k
±180deg
3
13.6 kg
Gremsy T3 [154]
10 mdeg
20 mdeg
$2 k
±180deg
3
1.7 kg
Standa 8MG-2SQ200 [155]
15 mdeg
n/a
$$$
±180deg
2
6 kg
Freefly Movi Pro [156]
n/a
n/a
$7 k
n/a
3
6.8 kg
Aerotech AMG200 [157]
1.39 mdeg
0.139 mdeg
$$$
±180deg
2
20 kg
Newport FG-URS [158]
0.5 mdeg
11.5 mdeg
$$
±180deg
2
10 kg
OES Pan-Tilt Stage [159]
1 mdeg
10 mdeg
$$$
±180deg
2
10 kg
FLIR PTU-5 [160]
50 mdeg
n/a
$3 k
±180deg
2
2.3 kg
Hudgens and Cawthon [66]
0.1 mdeg
5 mdeg
$$$
±67deg
2
11.3 kg
Li et al. [67]
0.0217 mdeg
0.819 mdeg
$$$
±178deg
2
5.5 kg
Ferris and Phillips [70]
24 mdeg
250 mdeg
$$$
±270deg
2
n/a
Qiu et al. [78]
n/a
3437.8 mdeg
$
±15deg
2
n/a
Rosheim and Sauter [82]
n/a
60 mdeg
$$
±90deg
2
2.3 kg
Antonello et al. [94]
n/a
0.57 mdeg
$$$
0–15 deg
2
n/a
Villgrattner et al. [93]
n/a
6.7 mdeg
$$
±30deg
3
0.04 kg
Lee et al. [101]
40 mdeg
n/a
$
±35.54deg
2
0.05 kg
Zelenika et al. [102]
n/a
n/a
$$$
±2deg
2
n/a
Huajun et al. [103]
0.0573 mdeg
10 mdeg
$$
±2deg
2
n/a
Chen et al. [107]
0.465 mdeg
n/a
$$$
n/a
6
n/a
Du et al. [125]
<5.7 mdeg
<17.2 mdeg
$$$
<± 0.026 deg
3
n/a
Burger and Eder [126]
0.389 mdeg
0.0217 mdeg
$$$
±0.017deg
2
1.3 kg
Henein et al. [127]
n/a
0.00802 mdeg
$$$
±0.001deg
2
0.075 kg
Aoki et al. [130]
n/a
0.057 mdeg
$$
±4deg
2
n/a
Geijo et al. [111]
1.39 mdeg
0.11 mdeg
$$$
±0.05deg
6
240 kg
Dong et al. [112]
<0.0057 mdeg
<0.0115 mdeg
$$$
±3deg
6
2 kg
Harvison and Hardy [131]
n/a
0.74 mdeg
$$$
±0.37deg
2
n/a
Bederson et al. [146]
11 mdeg
150 mdeg
$
n/a
2
0.015 kg
Jae-Sung Lee et al. [148]
5500 mdeg
n/a
$
±33deg
2
n/a
3. Methods
In this section, the developed design is introduced. First, we explain the general kinematic setup, consisting of an XY-Table and a double gimballed sliding lever setup. We then elaborate on our selection of mechanical actuators and transmission mechanisms and derive the overall system kinematics. By using integrated position encoders and custom control electronics, the system can be controlled in a closed-loop manner.
3.1. Proposed Orienting Mechanism
The Computer-Aided Design (CAD) of the most relevant sections of our gimbal is depicted in Figure 4. The central part of our proposed mechanism is the double gimbal lever system, which transforms a 2D translation from our actuators into a full 3D rotation. A solid shaft acts as the major orientation component at the core of this design, rotating around the center gimbal/universal joint while being actuated by the other one. The strength and extension of the rod give few limitations to the available space and carryable weight. Consequently, various sensors can be mounted at the end of the shaft with no interference with the gimbal frame.
Figure 4
Full system CAD: (a) Dynamixel servo motors; (b) frontal universal joint with linear sliding bearing; (c) second universal joint; (d) central lever shaft and sensor mounting point; (e) system frame; (f) XY-Table pan axis and ball screw; (g) XY-Table tilt axis and ball screw.
The lever not only performs the task of acting as the rotation platform but also serves the function of a mechanical reduction, reducing a longer low-torque motion into a shorter high-torque motion, thus decreasing the actuated step size and increasing the system’s precision.The actuation of the proposed double gimbal lever system is performed using the XY-Table, a part commonly found in 3D printers or Computer Numerical Control (CNC) machines. The mechanism consists of two orthogonal linear actuators that translate a working plane along two separate axes. Most commonly, for CNC machines, a workpiece would be mounted to this plane and passed through a mechanical processing procedure, such as a mill or lathe. The widespread use of this mechanism makes it possible to easily obtain high-quality and low-cost price components to assemble this subsystem and integrate it into our design.The central lever and the XY-Table are combined using the second universal joint, through which the lever endpoint is attached to the actuation plane of the motorized table. As a consequence of this arrangement, one endpoint of the central shaft is always located in the actuation plane, and the rotation point of the lever is locked in the platform frame using the front gimbal, resulting in a rotation motion around the latter. To adjust for the distance variation between the two gimbals, the former includes a sliding bearing that enables the central lever to move inwards and outwards. Additionally, this means that the sensor setup does not perform a pure rotation, but a translation along the pointing axis (a screw motion in total), which can be computed and accounted for in software, and does not significantly impact long-range optical sensing.A complete kinematic diagram of the mechanism, highlighting the two prismatic joints that form the XY-Table as well as two universal joints for the lever system, is shown in Figure 5.
Figure 5
Kinematic visualization of the proposed high-precision pointing mechanism. The two actuated prismatic joints comprise the XY-table, while the two spherical and the cylindrical joints make up the lever sub-system.
3.2. Actuation and Transmission Mechanism
The kinematic chain that actuates the final sensor mounting platform through the center shaft starts with two simple, commonly available rotary motors. The aim is to precisely control the position over the XY-Table. For this, a conversion from rotary motion to linear is required. An efficient way to achieve this is by using a linear spindle coupled with a ball screw bearing. This solution is widely used in the linear precision industry, for instance, amongst CNC machine makers, where it is generally required to have higher torques and smaller displacements. A spindle is fundamentally characterized by its pitch distance l, which is essentially the displacement of a ball screw after one spindle rotation. The rotation angle of the spindle and linear movement of the ball screw can consequently be linked using the cross-multiplication:For precision mechanisms, ball screws can be pre-loaded to reduce clearances, backlash and improve accuracy. This is typically done by manufacturing the ball bearing slightly smaller than the balls themselves and press-fitting them into the case. The torque required for movements is increased through this process, but backlash can be reduced to virtually zero. Stabilizing and fixing the moving platform of the XY-Table is done using linear guides and linear polymer bearings for a low-cost but stable and low clearance mounting solution.As previously described, the transmission mechanism consists of a double gimballed lever system. Placed after the XY-Table, the lever represents an essential system component. With the main task to convert linear motion back to rotary, this element also defines controllability, stability, and overall pointing speed. The lever’s length sets the balance between pointing precision and range of motion. By increasing this parameter, precision increases at the expense of decreasing pointing speed and increasing the frame size.The central shaft is mounted using two universal joints, which act as gimbals to enable the rod’s pitch and yaw rotation. These joints are realized using 2 round concentric cases, mounted using orthogonally placed ball bearings, permitting the rotation around two axes. Similar pre-loading as described earlier is done through press-fitting to reduce backlashes. This is done equally for both universal joints (see Figure 6).
Figure 6
Double-gimbal lever system for converting a translatory motion into a rotary one: (a) gimbal mounts; (b) central orienting shaft; (c) outer segment of universal joint for pan motion; (d) inner segment of universal joint for tilt motion; (e) circular joint in the form of a linear sliding bearing.
As one universal joint is static, while the other one moves within the actuation plane of the XY-Table, the distance between the two of them varies. A sliding joint is used to provide this extra degree of freedom required while enabling the shaft to freely move through the frontal universal joint. This is implemented using another linear polymer bearing to minimize clearances and backlash introduced into the system.
3.3. Actuator Selection
High-precision actuators can significantly add to a project’s cost, especially when factoring motor drivers, higher-level controllers, and communication interfaces. By using a completely integrated package, great results can be achieved at a low price point. After testing out some options, the system’s motor choice fell to the Dynamixel XL430-W250-T [161].This motor consists of a completely integrated package, combining a Direct Current (DC)-motor, gearbox, driver, and encoder. Positioning, speed, and acceleration are controlled using a Proportional–Integral–Derivative (PID) closed-loop system that relies on a 4096 step encoder for feedback. Furthermore, the package includes a 258 to 1 reduction gearbox that is placed in-between the DC-motor and position encoder to identify and control any potential backlash.Several package functions are based on an integrated microcontroller, which also enables a network interface to the outside to provide control commands via a half-duplex asynchronous serial connection. The final connection to a computer for the control interface is achieved using a custom-built Universal Serial Bus (USB) to half-duplex serial interface, which also integrates the power supply unit for the motors. The power supply consists of a simple commercially available buck converter, which reduces any DC input voltage to the required 12 V. Additionally, the manufacturer provides a Software Development Kit (SDK) to interface with the serial connection of the motors via the pre-defined protocol. This SDK is both available for Robot Operating System (ROS) [162], and Arduino to integrate further high-level real-time controls.Significant characteristics of the selected actuator for the represented use case are stall torque and encoder resolution. The Dynamixel’s built-in 4096 / encoder provides the system with the needed resolution for this application. Furthermore, as precision mechanisms in general, and especially ours, use several press-fittings to reduce joint clearances and backlash, a non-negligible actuation force is required, even through the several reduction gears. The maximum of 1.5 Nm of stall torque can apply a sufficient force to also overcome static friction, even for small and slow movements. Further specifications of the selected actuator can be seen in Table 2.
Table 2
Dynamixel XL430-W250-T specification according to the manufacturer. Of importance are especially the encoder resolution and the position control range, as well as a sufficient torque.
Characteristic
Specification
Price
$48.9
Supply Voltage
12 V
Stall Torque
1.5 Nm
Stall Current
1.4 A
No-load speed
61 rpm
Encoder resolutions
4096 steps/revolution
Temperature range
−5−72∘C
Dimensions (W × H × D)
28.5 mm × 46.5 mm × 34.0 mm
Position Control Range
±256 revolutions
Using 3D-printed mounts, these motors are directly attached to the mechanism’s overall frame. Custom milled motor fixations attach the motor output directly to the corresponding ball screw without any further gears.An alternative to using the fully integrated package would be a custom built solution. Significantly higher resolutions, torques, and speeds could be achieved as well using high-quality DC motors combined with harmonic drives [163], which exploit the deformation of gears to achieve high reduction rates and low backlash, as well as high-precision encoders [164]. Even individual components of such a setup will have significantly higher costs than the fully integrated package used for this research, and were therefore deemed over the price limit. A fully integrated motor setup using such high-quality components is the ANYdrive motor [165], but this was again above the target price point.
3.4. System Kinematics
A further in detail description of the kinematic transmission of movement from the integrated DC-motors to the final actuated sensor platform can be seen in Figure 7. According to this serial chain and by separating the individual axes of the mechanism, we can perform a simple analysis of the theoretical resolution and precision of the system, as well as its future movement control.
Figure 7
Block diagram visualization of the kinematic chain of the proposed mechanism, highlighting mechanical components inside the servo motors as well as the two subsystems, the XY-Table as well as the lever mechanism.
Due to the integrated position encoders and the respective PID controllers, both motors can be interpreted as complete and independent subsystems. Their outputs are the respective rotary motor positions and . Using the ball screw lead, which is identical for both ball screws, the x and y positions of the XY-Table can be computed as
on which the first universal joint is placed. The conversion of this linear movement into a rotary pitch () and yaw () is performed by the lever in combination with those two universal joints, as shown in Figure 6. The system’s attitude can then be computed as
where (, ) are the center’s coordinates of the XY-Table, and D the separation of the two universal joints when the lever is not deflected at all. From this, the theoretical pointing resolution
based on the reported Dynamixel motor resolution = 0.08789/step, the ball screw lead l = 5 mm/rev and the lever length can be computed. This accuracy computation is an approximation, assuming the system operates close to its origin. As the system moves further away from the center point, out of the region of linear approximation of the arctan function, the resolution will increase, resulting in smaller and smaller angular step sizes in comparison to the respective motor steps.The mathematical approximation of the gimbal model enables an understanding of the impact of design changes and component selection on the overall system performance. It can be observed that the pointing resolution is proportional to the motor resolutionThe pointing resolution is proportional to the ball screw leadIn addition, the pointing resolution is inversely proportional to the separation of the rotation center to the XY-Table planeBy further analyzing this chain of mechanical components, we can derive a generic kinematic description of the system for classifying it according to its joint placement. The XY-Table consists of two prismatic joints in series, making it a PP-mechanism. The lever mechanism is held in place by two universal joints as well as a cylindrical one to enable the sliding motion. This constitutes a UCU-mechanism. As both parts are placed in series, this results in a PPUCU-mechanism. Some notations place a line above the actuated joints, making this a mechanism.
3.5. Clearance and Error Analysis
Even though our design provides a great down stepping of the original motor’s resolution, the kinematic chain in Figure 7 also highlights many joints and mechanical interactions, which introduce the possibilities of clearances, backlash, bending, and other possible sources of error. The following section highlights an analysis of possible weaknesses of the mechanisms and how much they could potentially impair the system’s precision. An overview is also given in Table 3. Furthermore, we demonstrate approaches that were taken to mitigate possible issues.
Table 3
From the utilized components and overall system design, several sources of error can be identified and accounted for in the further steps of the system’s design.
Source of Error
Reason
Worst Error Estimate
Motor inaccuracies
Internal Gearbox
0 mdeg
Position deviation
Lever motion
15.47 mm
Linear guide
Axis fitting tolerance
5.29mdeg
Component bending
bending due to payload
5mdeg
Ball Bearing
Manufacturing tolerances
8.02mdeg
Motor Gearbox
Backlash
No data
3.5.1. Motors
The utilized Dynamixel motors come with an integrated gearbox. As stated in Section 2, georboxes are a frequent source of possible backlash. Some advantages of using the Dynamixel motors are, on the one hand, the precise industrial manufacturing, which already results in very low tolerances in the mechanism, and on the other hand, the backlash compensation happening while controlling the motor’s position due to the rotary encoder being placed at the end of the motor’s kinematic chain.
3.5.2. System Kinematics
The kinematics themselves do not result in a pure rotation, but there is also a falsely introduced translation of the sensor platform. Based on the system geometry shown in Figure 8, this can be calculated to be
using the gimbal to gimbal distance , based on the system’s deflection angles and :
Figure 8
Translation error introduced through rotation with a fixed-length shaft.
For the target application of LROD, this is not only a negligible deviation but also a predictable one and can therefore be disregarded for further development.
3.5.3. Ball Screws
Ball screws are an excellent option for precision mechanisms, as they can already come pre-loaded by their balls through the respective ball assembly [163]. The advantage of these is very low friction at high torque capabilities, which makes them a common, well-established, and affordable solution. The high-torque capability is especially beneficial due to the resistance created from the pre-loading of bearings within the various components. Sweeney et al. [151] also discusses the utility of ball screws in precision mechanisms, and how these can be utilized effectively.Ball screws can introduce two possible kinds of play into the mechanism: axial and radial. In our case, radial play is immediately compensated through linear guides mounted parallel to the ball screws. Axial play, however, can affect the accuracy of the system and the manufacturer’s pre-loading of the ball assembly is therefore of high importance [166].Unfortunately, as the utilized ball bearings were already available in our workshop, no manufacturer information is available about them. There does not seem to be any observable axial play, but the pressure exerted from linear guides on either side can also provide some pre-loading to reduce clearances, should there be any.
3.5.4. Linear Guides
According to the manufacturer’s specifications [167,168], there is a radial fitting tolerance of between the guide shaft and the respective shaft of the linear sliding bearing. A direction change of one axes could result in a backlash in the magnitude of the fitting tolerance, which cannot be ignored. Assuming all other variables remain constant, this could, according to Equation (6), result in a worst-case angular inaccuracy ofThis is, however, compensated by several effects:Press-fitting the bearings into the respective structural part will result in a more optimal, tighter fit.As two linear guides are used in parallel with a very tight fit, both bearings will be pre-loaded thus reducing any possible play [169].In addition to the two linear bearings for each axis, there is also the ball screw, fixating the moving platform further and reducing possible backlash.By controlling the movement protocol of the XY table, it can be assured that all bearings are always on the same side of their clearances during a backlash and therefore compensating further for possible backlash.
3.5.5. Universal Joints/Gimbals/Ball Bearings
Ball bearings are utilized at various locations throughout the mechanism, especially inside the two universal joints that fixate the orienting lever. Axial play of the balls in these locations could dramatically affect the overall pointing precision of the device. During a simple direction change of motion, this clearance could cause a backlash in both universal joints, having double the effect on the pointing accuracy. Our design utilizes ball bearings by SKF featuring a axial play [170,171]. A deviation of 7 µm in both gimbals could lead according to Equation (6) to an error ofAgain, several compensating effects are utilized:The most significant compensation action is the pre-loading of any bearing. This can be done in two ways: Simple press-fitting of the bearing onto the shaft and inside the casing will apply a significant force onto it and thus will permanently keep it at one side of the bearing’s clearance and reduce backlash [163].Spring-loading is a second method to reduce a bearing’s backlash but is not utilized in our design.Finally, again some backlash can be compensated for in the controls and calibration of the mechanism, though this can be unpredictable and might suffer in dynamic environments with high vibrations.
3.5.6. Frontal Linear Guide
The rotation center’s linear guide provides the extra degree of freedom for the system to transform the XY-Table translation into a rotation freely. The main shaft only moves inwards and does not conduct any rotary movement with respect to the linear bearing. The sleeve was purposely lengthened in this location to 20 mm to reduce the effect of any potential radial play. Low clearance and proper compatibility are especially ensured by having both the shaft and its sleeve manufactured by the same company. Furthermore, payload mass and gravity as a restoring force provide a degree of pre-loading onto the bearing, but further measures to reduce possible clearances could be applied in the future.
3.5.7. Bending Moments
The bending of the central shaft or other mounting components could introduce errors to the pointing accuracy. However, most components are milled out of aluminum and significantly over-dimensioned for the expected future payload. Furthermore, it is also assumed that should there be any significant bending effects; these should be constant in static measurement situations and would therefore only introduce a linear offset which can be compensated for in calibration.
3.5.8. Symmetry
Symmetric designs can compensate for many sources of errors like thermal expansion or bending in high-precision mechanisms [172]. As the linear stages, gimbals and chassis are fairly symmetric, the design benefits of symmetry error advantages. The book highlights the good practice of placing measurement axis in symmetry planes, balancing the effects of thermal expansion affecting either side of the symmetric plane equally. This practice has been adopted on many occasions throughout the design, specifically in the linear stages of the XY-Table and gimbals for the lever mechanism, but also the overall system frame.
3.6. Encoder and Position Feedback
In most common pan-tilt serial gimbal mechanisms, the encoder is placed at the rotational joint providing a direct measurement of the current orientation, enabling complete closed-loop control and the capability to adjust for any backlash or other errors. For high-precision measurements, this requires a very high-resolution position encoder, such as an EAM580-B [173]. However, even these expensive encoders only feature 14-bit single turn precision resulting in an angular step resolution of .Our proposed mechanism utilizes the cheap AS5601 12-bit encoders [174] which are integrated into the motor package. As these are placed earlier in the mechanism in front of several down-stepping mechanisms, we can utilize the encoder over multiple motor turns, achieving a much higher step resolution, resulting in a final angular resolution of . The disadvantage of this placement is that the encoder is not at the end of the kinematic chain (as seen in Figure 7). This means that parts of the mechanism do not provide position feedback and therefore run in open-loop control. In the future application, this can be extended and improved using the sensors available in the to be mounted sensor platform, such as cameras and Inertial Measurement Unit (IMUs).
3.7. Control Systems
The general control systems of the developed pointing mechanism are integrated into the Dynamixel motor package. These motors interface with a control computer using a simple half-serial duplex communication. On the computer side, an interface is created using ROS [175] and the Dynamixel SDK. Transformation functions and the system kinematics can then be easily modeled in ROS to convert angular commands into the respective motor and encoder positions.Low-level movement controls are handled by the integrated Cortex-M3 microcontroller, which handles position and velocity PID control to precisely steer the gimbal.As the communication via USB with the computer and ROS and the sending of reactive commands is not a real-time operation, we have developed a second operation mode. In this case, an additional microcontroller in the form of an Arduino Zero [176] is placed in between the computer and the motors. The Arduino is now capable of collecting information from various sensors and sending real-time commands to the motors for precise control. Furthermore, by also running VersaVIS [177] on this microcontroller, the current gimbal positions can be precisely timestamped. High-level commands can still be sent from the computer via ROS and ROSserial [178] to the Arduino, which are processed and sent on to the motors. This allows, for example, the integration of optical limit switches [179], similar to ones found in 3D printers, which can be used for precise calibration of the gimbal parameters and motor encoders. Furthermore, in combination with IMUs, the Arduino could send commands for stabilization and disturbance suppression to the motor, which a computer could not provide in real-time.
4. Experimental Evaluation
To evaluate the pointing accuracy of the developed system, we performed a series of experiments in a controlled environment. In order to perform a direct and fair comparison to commercially available systems, we performed the same experiments using a consumer-level cinematography gimbal.
4.1. Experimental Setup
4.1.1. Environment
The experiments were performed in a controlled lab environment to ensure the highest possible accuracy. The pointing device was placed at one end of a long and empty corridor, with target points placed at the opposite end. To observe the precise movements of the orienting mechanism, a laser diode was mounted in place of the future sensor setup to highlight the targeted position at the end of the measuring range. Individual measurement points of the laser diode were recorded on graph paper located at the opposite end of the corridor. To minimize distortions, the paper was mounted to a flat board that was secured to the wall. The measuring distance between the target area and the pointing mechanism was measured using a Leica Disto D8, a separate construction grade laser distance meter with an accuracy of [180]. It was measured from the center of rotation in the frontal gimbal of the pointing platform to the graph paper sheet and determined to be .The system was securely mounted to a table using clamps, and all moving parts and cables were securely fixed to the table to prevent any disturbances. The control computer from which an operator can send position commands was placed on a separate table to minimize the interactions with the system.
4.1.2. System Setup
The mechatronic components of the pointing mechanism were controlled from a separate computer via a self-developed control board. On the software side, the servos are controlled using the Dynamixel SDK, provided by the manufacturer, as well as a custom ROS node, to send commands according to the specified experiment protocol. The low-level position control of the gimbal is performed by the Dynamixel internal micro-controller using a PID controller. The values for which were chosen to be: , , .The visualization of the targeted position is done using a laser diode. This is mounted instead of the sensor platform using a 3D-printed fixture. The utilized diode is a Picotronic DA650-1-5(11X60) [181] and has a focal length of , with a beam diameter of and a beam divergence of . It is possible to visually determine a center of the projected laser point, but ultimately this places a lower limit on the evaluation accuracy of this experiment.
4.1.3. Calibration
The pointing mechanism has a few mechanical parameters which are originally undetermined and can be obtained through a calibration procedure from a set of measurement points. The most significant parameter is the principal point of the mechanism. As the motor encoders set their origin at an arbitrary location, it is necessary to determine the encoder position of the pointing origin when no deflection takes place. As the lever motion does not linearly transform encoder steps into angular steps, this is especially significant. This means that the pointing resolution at the principal point is the lowest (the worst) and increases (improves) towards the edges. This nonlinearity can be used in combination with a set of measurements to determine the principal point relative to the origin of the motor encoders.Further system calibration parameters stem from various manufacturing inaccuracies. It can be observed, that the axes of the XY-Table are not perfectly perpendicular, but slightly skewed. This defect can be determined through calibration and, therefore, can be compensated for in the experimental setup. A deviation of 0.175 deg has been observed.
4.1.4. Experimental Protocol
The limited space of the long corridor does not permit a high-accuracy evaluation of the system’s full range of motion. The first step of the experiment was, therefore, to determine the maximally available range of motion, which will still result in all projected laser points lying within the target area. This range of motion was determined to be in pan and in tilt. To prevent a human bias in the selection of target points, these were sampled uniformly within the previously determined range.Furthermore, a control strategy has been implemented to minimize backlash and bending effects. This strategy can shortly be summarized as:Input of new target position.Orienting mechanism is actuated along the tilt axis to 500 encoder steps on top of the desired target tilt coordinate.Orienting mechanism is actuated along the tilt axis to the desired target tilt coordinate.Orienting mechanism is actuated along the pan axis to 500 encoder steps on left of the desired target pan coordinate.Orienting mechanism is actuated along the pan axis to the desired target pan coordinate.This strategy ensures that target points are always approached from the same direction (top-left), ensuring that backlash and bending effects always influence the result in the same way and can therefore be controlled.Before the beginning of the experiment, the PID values of the integrated motor controllers were tuned manually. Convergence speed was not a priority during this experiment, so these values were chosen in order to ensure convergence with minimal overshoot.The overall experiment protocol for recording data points was therefore:Generate a new random target position.Actuate the orienting mechanism to the given target position according to the previously defined control strategy.On the controller side, the commanded target position is recorded, as well as the continuously reported pointing position as the mechanism acts upon the command. Additionally, the final convergence point is recorded. For later data association, each target position is assigned an ID, which is also assigned to all associated recordings.The projected target point on the graph paper is manually recorded with the respective target ID.At the end of the experiment, the data points are manually read off from the graph paper and added to the digital recording of the controller commands and values. This manual process also limits the evaluation accuracy, as points could only be read off to an approximate accuracy of .
4.2. Results
From the previously described experiment, a total number of 182 corresponding measurement points could be obtained. These lie in a measuring range of along the pan axis and along the tilt axis. Two measurements have been removed, as they were out of the range of the manual recording process. One measurement has been removed, as it is presumed to be a manual measurement error, due to its significant misalignment, resulting in a total of 179 measurement points. The subsequent sections will analyze this data regarding the overall pointing error, and try to recognize individual sources of error within the mechanism. Manual measurement points on the graph paper have been converted to degrees based on the distance measurement to the wall of . Recorded encoder position values have been converted to the corresponding gimbal attitude in degrees based on the previously described system kinematics and a system calibration obtained from a subset of the measurement points. The final measurement points have been aligned with the target points to remove any linear offsets in the mechanism or the experimental setup using least-squares optimization. This would also be part of a complete calibration procedure.
4.2.1. Overall Pointing Error
A first evaluation can be done by comparing the commanded position values to those observed in the experiment. This can be observed in Figure 9 by comparing commanded (blue) and measured (red) point positions. This can be observed to be an Root Mean Square Error (RMSE) of 6.203 mdeg, as well as a maximum error of 18.824 mdeg. Due to the motor’s internal PID-controller, the commanded position is, however, not always identical to the reached position of the motor and therefore the actual gimbal attitude. However, this error is observable through the motor encoders and therefore enables a second evaluation of the gimbal attitude reported by the encoders to the measured values. This RMSE is determined to be 6.179 mdeg with a maximum error of 18.854 mdeg, which is also shown in Table 4. In addition, 83.8% of measuring points were therefore within the required accuracy range of 7.5 mdeg.
Figure 9
Representation of commanded (blue) and reported (green) to measured (red) pointing position. Due to good motor controls, the reported position is nearly always covered by the commanded position.
Table 4
This table highlights the individual pointing errors of each axis as well as the overall pointing error. Both the RMSE () and the maximum pointing error () are shown.
Pan Axis
Tilt Axis
Total
ϵRMSE
2.801 mdeg
3.671 mdeg
6.179 mdeg
ϵmax
9.355 mdeg
18.278 mdeg
18.854 mdeg
In all further evaluations, the reported value of the motor encoders will be used to determine the relevant gimbal attitude, as this value is not subject to PID-controller tuning or other control mechanisms.A histogram plot visualizing the distribution of pointing errors can be seen in Figure 10a. This graph also highlights that the majority of all measurement points lie within the required pointing accuracy. The spread of pointing errors throughout the measuring range is visualized using a heatmap in Figure 10b, showing regions of larger or lower error.
Figure 10
(a,b) visualize the system’s overall pointing error and its distribution. (a) Histrogram highlighting the distribution of RMSE pointing errors. The red line highlights our overall accuracy requirement (b) Heatmap visualization of pointing errors. Large red-spot due to one large mis-aligned measurement and no further points in that area.
4.2.2. Evaluating Axis Performance
The pan and tilt axis of the mechanism can be regarded as separate from each other, as one does not influence the other and should therefore both be evaluated individually. Figure 11 visualizes the mis-projection of each individual measurement point. The minimum required pointing accuracy is highlighted using the red circle and shows that the majority of measurement points fulfill this requirement.
Figure 11
Relative RMSE of each individual measurement point. The red circle shows our requirement accuracy of 7.5 mdeg.
Figure 12a shows the distribution of orienting errors along each axis. A slightly wider error distribution can be observed for the tilt axis. This is also represented in the RMSE values, where along the pan axis an error of 2.801 mdeg with a maximum of 9.355 mdeg is achieved, while along the tilt axis a RMSE of 3.671 mdeg with a maximum of 18.278 mdeg is observable.
Figure 12
Evaluating error distribution and system linearity for both the pan (blue) and tilt (green) axis. (a) Histogram of error distribution along the individual axis; (b) Linearity of commanded position to the measured output.
Furthermore, by separating the data into individual axes, a slight skew in the mechanism is observable. This is due to a misalignment of the pan and tilt axis during assembly. A rotation of 0.175 deg of the tilt axis relative to the pan one can be determined. However, this can be compensated for in calibration and has already been included in the previously stated system calibration.
4.2.3. Observing Linearity of Command and Measure Points
An essential factor, especially for later control systems, is the system’s linearity. How well do measured position and target position coincide? This is shown in Figure 12b. From both visualizations, it can be seen that the system expressed a very linear behavior. This can also be quantified by computing the correlation of each set, resulting in a value of for the pan axis, as well as for the tile axis.
4.2.4. Error Source Analysis
Certain types of induced errors can be proportional to the distance travelled, the distance between two consecutive measurement points, of the mechanism. This can for example be friction or bending effects in the mechanism, which accumulate during the motion from one measurement point to the next.This correlation would not have to be linear, but neither Figure 13 nor the logarithmic version revealed any distinguishable correlation.
Figure 13
Comparison of distance travelled between two consecutive measurement points to the respective RMSE of the following measurement point.
This can mostly be accredited to the employed control methods and movement protocols, described in Section 4.1.4, which specifically aimed at reducing such errors.
4.2.5. Commercial Gimbal Comparison
To perform a direct comparison to commercially available solutions in the same price segment, we repeated the same experiment using a DJI RS2 cinematography gimbal. The measurement range was determined to be 46.12 m, but due to the very limited resolution of the gimbal of only 0.1 deg, only very few measurement points could be obtained. In total, 107 points were recorded.A similar RMSE visualiszation has been created in Figure 14 and the RMSE has been calculated to be 30.93 mdeg.
Figure 14
RMSE evaluation of the DJI RS2.
This error is significantly higher than what would be usable for our target application, but even more, the very limited actuation resolution makes this an unsuitable solution to our problem.
4.3. Discussion
From the reported experimental results, several observations and conclusions can be drawn regarding the system’s precision:The observed pointing precision is as close as possible to the evaluation precision of the experimental setup. Over the available measurement range, even deviations of single millimeters cause errors in the range of millidegrees. Therefore, the evaluation accuracy is limited by the laser-pointer’s accuracy, the marking of the experimenter, and the later digitalization of the paper markings.Furthermore, the recording graph paper, which was taped to a pinboard fixed on a wall, is a possible source of error by itself.Effectively, bending of the data recording paper might have caused the measurement distortion seen in the left part of Figure 10b. It is, therefore, hard to conclude with the available measuring equipment, whether the actual pointing accuracy is equal to the observed one or if the system is even more precise but can not be evaluated at the better precision.A second observable source of error comes from the linear bearing within the frontal gimbal, responsible for the free movement of the orienting shaft. This bearing has been damaged slightly during assembly, resulting in minimal play. Fortunately, performance is not significantly impacted statically due to the effect of gravity and the large diameter of both the shaft and bearing; nevertheless, the part would need to be replaced for more dynamic scenarios.Nonlinear bending effects in 3D printed components like the motor mounts could still impact performance. This could be evaluated using a Finite Element Method (FEM) simulation and their design could be further optimized, for example using generative design methods. Furthermore, adequate control methods could be used to compensate for these effects [182].As the calibration of the mechanism’s intrinsic parameters, especially the principal point, is currently done using external experiment data; these are also subject to the same experimental inaccuracies. We are therefore planning to expand the system’s controls using optical limit switches (such as ones found in CNC machines and 3D printers), to perform an automatic self-calibration.Furthermore, it can be observed that significantly more projection errors are observable in the tilt axis than the pan axis. This could be caused by the staging in the XY-Table, as the tilt axis has to carry more loads and might be subject to more vibrations from the series of actuators. For our future target application of Long-Range Obstacle Detection, this is not problematic, as the pan axis is more critical for covering the vehicle’s FoV.Oscillations during the convergence to a new measurement point due to the motor’s internal PID controls are also a possible source of inaccuracies. These can be reduced using further and more extensive tuning of the PID parameters.
5. Cost Analysis
One of the main goals of this project was to develop a low-cost system. The total cost of the utilized components was $1000 and is broken down in Table 5. Where components were manufactured using available in-house machinery, such as 3D printers and CNC machines, only material costs are listed.
Table 5
Project cost analysis including purchased components and materials. As manufacturing took place in-house, this is not listed here. Some components were already available in the workshop and their original price is not known; the respective costs were estimated.
Component
Amount
Price
Total
Dynamixel xl430-w250-t
2
$48.90
$97.80
Motor controller (estimated)
1
$10.00
$10.00
SKF W617/5 Bearing
8
$5.39
$43.08
SKF WBB1-8705 Bearing
4
$5.39
$21.54
igus JSM-1618-10 linear guide
1
$3.91
$3.91
igus LSM-1012-20 linear guide
4
$4.31
$17.23
igus sliding axis 16 mm
1
$43.08
$43.08
igus sliding axis 10 mm
4
$32.31
$129.24
Ball screws (estimated)
2
$200.00
$400.00
Aluminium frame and fastenerys
$179.68
3D print PETG filament
$10.77
Aluminium 6061 blocks
$53.85
Total
$1010.18
The manufacturing cost for a comparable system using a classical serial pan/tilt design, which employs high-precision components, such as harmonic gearboxes, precision motors, encoders, and additional materials, was estimated to amount to approximately $2500.
6. Conclusions
In this paper, we demonstrated a high-precision pointing mechanism for future utilization in a railway Long-Range Obstacle Detection. Due to the low target price point, the system consists of simple and widely available low-cost components as well as in-house manufactured parts. By creating a novel actuation mechanism consisting of a common XY-Table and a double-hinged lever system, a very small rotation resolution was achieved. Various means of pre-loading can keep clearances in the mechanism, and therefore backlash to a minimum, resulting in very high-precision and high accuracy in the device’s pointing performance. We validated our design using a controlled indoor experiment, during which we recorded measurements over a range of nearly 50 m. Our experiment has shown that our system is capable of precisely and accurately targeting individual points at a long range, with an angular resolution comparable to that required for detecting humans at 1500 m using a long-range LiDAR. The achieved pointing precision reached what was possible to evaluate using our available experimental procedure, and highlighted the challenges of testing and calibrating high-precision equipment. For the future target application of LROD, this provides sufficient pointing precision to target and track long-range obstacles reliably. The high pan position accuracy makes this mechanism particularly suitable to explore the train’s FoV. Nevertheless, the impact of vibrations and disturbances from train operations will have to be investigated further in the future.We plan to continue the development of this mechanism, specifically in the realm of controls, to be able to achieve high-pointing precision under dynamic scenarios, remove possible nonlinear errors from bending or backlash effects, and integrate a self-calibration procedure. Furthermore, we aim to combine this with a suitable long-range sensor setup, consisting of a 1D-LiDAR and several cameras to construct a complete Long-Range Obstacle Detection system.
Authors: Florian Tschopp; Michael Riner; Marius Fehr; Lukas Bernreiter; Fadri Furrer; Tonci Novkovic; Andreas Pfrunder; Cesar Cadena; Roland Siegwart; Juan Nieto Journal: Sensors (Basel) Date: 2020-03-06 Impact factor: 3.576