Xinyu Pang1,2,3, Yi Yu1,3, Zhou Li1,3, Zhiyuan Sun1,3, Chun Li1,3, Guoqing Yang1,3. 1. Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China. 2. University of Chinese Academy of Sciences, Beijing 100049, China. 3. Key Laboratory of Space-Based Dynamic & Rapid Optical Imaging Technology, Chinese Academy of Sciences, Changchun 130033, China.
Abstract
Highly accurate measurements of infrared systems cannot be achieved without precise radiometric calibrations. In order to correctly interpret and process infrared images and monitor the performance of infrared cameras, their radiometric calibration is also required periodically. In this paper, an equivalent calibration method is proposed based on an internal blackbody baffle. It is used for the replacement of a large surface-source blackbody covering the aperture for the field calibration of large-aperture equipment. Subsequently, the expressions of the equivalent calibration conversion function (ECCF) are derived based on the grayscale response of the camera and the calibration models of the two methods, and experimental measurements and fits are performed using a cooled mid-wave infrared camera. The results show that the measured functional form is consistent with the physical meaning. Moreover, in the target imaging experiments, the results of the inversion using the equivalent calibration conversion function and the results of the direct calibration of the external blackbody are largely consistent with the average error of 0.198% between the two, and the maximum error is within 1%. The maximum error between the inversion result of radiation brightness and the actual value of the target is 6.29%, and the accuracy fully meets the radiometric measurement requirements.
Highly accurate measurements of infrared systems cannot be achieved without precise radiometric calibrations. In order to correctly interpret and process infrared images and monitor the performance of infrared cameras, their radiometric calibration is also required periodically. In this paper, an equivalent calibration method is proposed based on an internal blackbody baffle. It is used for the replacement of a large surface-source blackbody covering the aperture for the field calibration of large-aperture equipment. Subsequently, the expressions of the equivalent calibration conversion function (ECCF) are derived based on the grayscale response of the camera and the calibration models of the two methods, and experimental measurements and fits are performed using a cooled mid-wave infrared camera. The results show that the measured functional form is consistent with the physical meaning. Moreover, in the target imaging experiments, the results of the inversion using the equivalent calibration conversion function and the results of the direct calibration of the external blackbody are largely consistent with the average error of 0.198% between the two, and the maximum error is within 1%. The maximum error between the inversion result of radiation brightness and the actual value of the target is 6.29%, and the accuracy fully meets the radiometric measurement requirements.
With the continuous development of infrared imaging and infrared detection technologies, the measurement of infrared radiometric characteristics has become an important tool for feature acquisition and the identification of complex or weak targets [1,2,3,4]. Obtaining quantitative data from an infrared camera requires radiometric calibration, which relates the grayscale values of the digital image output from the camera to physical quantities such as radiance, and establishes a quantitative relationship between the input and output quantities [5,6].Infrared measurement equipment requires recalibration of the system for calibration data updates before performing measurement tasks in the field. For large-aperture radiometric measurement equipment, it is necessary to prepare large surface-source blackbodies capable of covering that aperture [7,8]. The development cost of large surface-source blackbodies is high, the equipment development is tedious, and the temperature stabilization time is long, making the calibration working time long, the workload heavy, and the equipment maintenance cost high [9,10,11].This paper presents an equivalent calibration method based on an internal blackbody baffle. After the infrared measurement equipment is calibrated in the laboratory to determine the equivalent calibration conversion function, a simple calibration process using the blackbody baffle can be equivalently converted to an external blackbody calibration covering the pupil when the calibration work is performed in the external field, without the need for a large surface-source blackbody matching the aperture of the equipment, leading to improved calibration efficiency and reduced associated costs.In Section 2, the response model of the infrared camera detector and the calibration model of the system are analyzed, along with the effect of the ambient temperature on the calibration model. Section 3 provides a detailed theoretical description of the proposed equivalent calibration method, derives the mathematical expression of the equivalent calibration conversion function, and introduces the specific measurement method. In Section 4, calibration experiments and comparative analysis of the data are carried out to verify the above theory. In Section 5, it is concluded that the proposed method is effective and can be used as an alternative to the external large-field surface-source blackbody calibration method, and that the calibration accuracy is no less than that with the direct use of external blackbodies.
2. Detector Response of the Infrared Radiation Measurement System
2.1. Linear Response of the FPA of the Infrared Camera Detector
Since cooled infrared focal plane arrays are generally better than uncooled focal plane arrays in terms of sensitivity, minimum detection temperature, and other performance metrics [12,13], they are usually suitable for military fields with high requirements for imaging quality and precision measurement.The linear response model of the cooled infrared focal plane array is the basis of infrared radiation characteristic measurement technology. The output digital image is a series of processes that transform the photoelectrons emitted from the infrared radiation source into the sensitive elements of the focal plane during a certain exposure time, thereby exciting a charge, and the accumulated charge generates a voltage, which is converted into a digital grayscale value [14,15]. This process is represented in Figure 1.
Figure 1
Physical model of the linear response process of the detector.
Assuming that the number of photons incident on the infrared measurement system is and the number of charges excited by photon radiation is , the photoelectric conversion efficiency of the detector is as follows:If the area of every pixel of the detector is , the relationship between the radiant exitance (in ) of the target and its photon number in a unit of time is as follows:
where is the speed of light, which is , and is Planck’s constant, which is .For the infrared optical system with the detection band of , if the size of the pixel is fixed, the accumulated charge on the focal plane of the pixel has a linear relationship with the emittance of the radiation source at a specific wavelength. The accumulated charge of the infrared FPA is converted into voltage, which is amplified by a linear circuit, and the linear magnification is recorded as . Finally, the output digital gray value is . This process can be described as follows:
where is the internal offset of the detector, which is caused by the fact that the photosensitive material of the infrared focal plane itself and the subsequent optical system cannot be completely cooled to absolute temperature, and its radiation photons are also converted into digital grayscale.
2.2. Radiometric Calibration Model of the Near-Extended Area Blackbody Source
The infrared radiation characteristic measurement is based on the infrared image acquired by the system, and the radiation flux of the entrance pupil of the system is obtained; then, the radiation characteristic of the target is calculated. Therefore, it is necessary to obtain the response parameters of the infrared camera’s FPA through radiometric calibration, and to establish the quantitative relationship between the target radiation and the output gray value of the system [16,17].The blackbody calibration method of near-extended source (NES) is the most common calibration method in the field of infrared radiometric measurement. An area blackbody source with high emissivity and good uniformity is used as the standard extended source to calibrate the system, and the effective radiation surface of the area blackbody source needs to completely cover the entrance pupil of the system. is the focal distance of the optical lens. The calibration principle is shown in Figure 2.
Figure 2
Schematic diagram of radiometric calibration using the near-extended area blackbody with geometric distribution of infrared radiation transmission.
According to Planck’s radiation law, the radiance emitted by a blackbody with emissivity of and temperature of is as follows:
where is the radiance emitted by an ideal blackbody, the first radiation constant is , and the second radiation constant is .The radiant power received by each image pixel from the calibrated blackbody can be expressed as follows [7,8]:For a given infrared system, is a constant, is the average spectral transmittance of the optical system in the corresponding wavelength band, is the pupil diameter of the system, and is the focal length of the system.According to Equations (2) and (5), the calibration equation, which is the linear relationship between the output grayscale and the input radiance of the IR system, can be determined as follows:By changing the temperature of the blackbody, and through the fitting of temperature and response grayscale values, the response gain and response offset of the detector can be obtained.
2.3. Infrared System Calibration Model Considering Ambient Temperature and Stray Radiation
The radiation received by the detector also includes the spontaneous radiation of the infrared optical system and the reflected ambient radiation, which is closely related to the ambient temperature, and can be called stray radiation. When the environment changes, the output gray value shifts, which affects the calibration accuracy [18].For infrared imaging systems, stray radiation comes mainly from the radiation of the lens, the housing cone, and other mechanical structures. The radiation of the lens and other components is determined by their own temperature. Due to their thermal conductivity, the temperature of the components becomes uniform. In this paper, all components except for the detector are assumed to be at an ambient temperature [19,20]. Figure 3 shows a schematic diagram of the stray radiation transmission of the imaging system.
Figure 3
Geometry of stray radiation. ➀ self-radiation from the optical lens; ➁ radiation received directly by the detector from mechanical structures such as the housing cone; ➂ radiation from the housing cone and other mechanical structures through the lens to reach the detector; ➃ radiation from the housing cone and other mechanical structures after reflection through the lens into the detector.
The stray radiation received by the detector consists of four main parts: (1) self-radiation from the optical lens; (2) radiation received directly by the detector from mechanical structures such as the housing cone; (3) radiation from the housing cone and other mechanical structures through the lens to reach the detector; and (4) radiation from the housing cone and other mechanical structures after reflection through the lens into the detector.In summary, when considering the ambient temperature and stray radiation, the radiant power received by the detector at the time of calibration can be expressed as follows:
where the narcissus radiation power is the radiation of the cooled detector reflected by the optics, which can be weakened by reducing the reflectivity of the core surface, and is independent of the ambient temperature [16].represents the spontaneous radiation of the optical lens:
where is the radiant brightness of the lens at ambient temperature , which is related to the emissivity of the lens; is the projected solid angle of the system’s pupil as seen from the pixel; and is area of the pixel.is the stray radiation generated by the housing cone and the other mechanical structures:
where , , , is the emissivity of the stray radiation element, its area is , denotes the projected solid angle, is the transmittance of the optical lens, and is the path reflectance. is the theoretical constant for a given infrared system, and the flux resulting from stray radiation of the system is directly proportional to the radiance of an ideal blackbody at ambient temperature.Combining Equations (5)–(9), we can obtain the infrared system calibration model considering the ambient temperature:
where is the response gain of the stray radiation related to ambient temperature.
3. Equivalent Calibration of Infrared Systems Based on Blackbody Baffle
3.1. Establishment of the Equivalent Calibration Conversion Function Model
At present, the system calibration of large aperture-infrared radiation characteristic measurement equipment relies on the large-area blackbody source matching its aperture, which brings higher costs and a greater workload to the calibration work, making it comparatively cumbersome to carry out. To solve the above problems, an equivalent calibration method for IR systems based on blackbody baffle is proposed. The method needs to fit the correspondence between the infrared image system calibration and the blackbody baffle calibration, and its working principle is shown in Figure 4. Figure 4A shows the schematic diagram of the calibration of the whole infrared system, while Figure 4B shows the schematic diagram of the detector calibration based on blackbody baffle.
Figure 4
(A) Schematic diagram of the device for the calibration of the whole infrared system; geometric optical distribution of the infrared radiation at the detector pixel when observing the external blackbody. (B) Schematic of detector calibration based on blackbody baffle; geometric optical distribution of infrared radiation at the pixel.
According to the derivation of the equations in Section 2, the radiant power received at the pixel of the whole infrared system calibration is as follows:
where is the reflected radiant power of the background environment from the lens.When using the blackbody baffle for direct calibration, the radiant power received by the pixel is as follows:Equation (11) describes the relevant physical quantities in Figure 4A, where is the radiance emitted by the external blackbody at temperature ; is the area of the optical system pupil (mid-wave infrared lens); is the projected solid angle of the pixel’s instantaneous field of view, determined by the pixel area and the distance from the detector to the pupil of the system; is the spectral transmittance of the infrared lens; is the spectral transmittance of the atmosphere, which is approximately equal to 1 at a short distance and in the indoor environment; is the radiance of the lens at ambient temperature ; is the projected solid angle of the lens as seen from the pixel; and represents the coefficients related to stray radiation.In Equation (12), is the radiance emitted by the blackbody baffle as a function of its temperature , and is the projected solid angle when viewing the baffle from the pixel, determined by the size of the cold aperture of the infrared camera and the distance between the detector and the cold aperture.In order to characterize the relationship between the two calibration methods, we define an equivalent calibration conversion function , as follows:
where the emissivity of the lens is and the reflectivity is at ambient temperature , and the radiance of the lens is equal to the radiance emitted by an ideal blackbody with emissivity of :In cooled infrared radiation measurement systems, the detector is in a low-temperature environment, and the value of is small enough, so we ignore the narcissus in this article for the sake of simplicity.When the external blackbody is used as the baffle blackbody, and both have the same temperature setting, there is:In summary, the equivalent calibration conversion function at a certain ambient temperature can be simplified as follows:At a certain ambient temperature, there is only one variable in Equation (18) for a certain infrared radiation characteristic measurement system; that is, is a function of the blackbody temperature.
3.2. Measurement of the Equivalent Calibration Conversion Function
The output grayscale of the infrared camera is proportional to the radiant power received by the detector, so the relationship between the grayscale response of the camera and in both cases can be written as follows:
where is the grayscale response of the optical system when observing the external blackbody, is the grayscale response of the detector when directly observing the baffle blackbody, and is the grayscale value generated by the internal offset of the detector—independent of the input radiant power. Through the equivalent calibration conversion function, the response of the baffle blackbody can be converted to the equivalent external blackbody response to complete the calibration conversion.The specific measurement process of the function for the baffle blackbody’s temperature-dependent ratio is as follows: A series of blackbody temperatures are set in the camera’s temperature measurement range with the same indoor environment. By alternately measuring a series of optical imaging system calibration images and baffle blackbody calibration images at the same temperature, the ratio of their gray values can be calculated, as follows:Because there is almost no stray radiation in the calibration of the baffle blackbody, the internal offset of the detector can be calculated by the calibration fitting curve of the baffle blackbody.After enough data are collected, the mathematical relationship between the equivalent calibration conversion function and the blackbody temperature can be determined by numerical fitting, and the gray response of the equivalent external blackbody at any temperature can be calculated using this relationship.
4. Laboratory Measurements
In order to verify the theories elaborated above, the experiments were conducted in two parts, in a laboratory with a relatively stable environment. Firstly, radiation calibration experiments were performed in the laboratory to determine the equivalent conversion function. In the second part, imaging experiments were performed to acquire infrared images of the target blackbody at different temperatures, and the radiometric radiance inversion of the images was performed using the equivalent calibration conversion function measured in the first part, and compared with the actual values.A cooled mid-wave infrared (MWIR) camera with a forward-looking infrared (FLIR) system and a large-scale mercury cadmium telluride (MCT) focal plane array (FPA) with pixels was selected for the radiometric calibration experiments. The experiments were conducted using a mid-wave infrared lens with a focal length of 50 mm, an aperture of 25 mm, and a transmittance of about 0.9. An area blackbody source with highly effective emissivity was selected as the calibrated blackbody. The specific parameters of the camera and the blackbody device are given in Table 1 and Table 2, respectively.
Table 1
Parameters of the cooled infrared camera.
Materials
HgCdTe
Spectral range
3.7μm~4.8μm
Aperture
f/4
Pixel size
15µm×15μm
Digital output depth
14
Resolution
320 (H) × 256 (V)
Operating temperature
−40 °C~+60 °C
Table 2
Parameters of the area source blackbody.
Blackbody emitter size
100mm×100mm
Operating temperature range
0 °C~125 °C
Temperature accuracy
0.01 °C
Effective emissivity
0.97
Operating temperature head
−20 °C~70 °C
Operating temperature controller
0 °C~50 °C
4.1. Experimental Measurement of the Equivalent Calibration Conversion Function
Non-uniformity correction of the detector is required prior to IR calibration. Although the thermal radiation from the blackbody radiation source is uniform, the response of the detector is indeed inhomogeneous due to reasons such as manufacturing, which requires non-uniformity correction to achieve its uniform response [21]. Since this article focuses on the calibration method, it does not provide the non-uniformity correction process. All calibration images in this paper were corrected using a non-uniformity correction algorithm. The grayscale distribution of the calibrated images and the non-uniformity of their pixels at a certain temperature at a certain integration time are given in Figure 5 as an example to show that the detector is uniformly illuminated. In both cases, the non-uniformity of the pixels is within 0.8%, indicating a uniform detector response.
Figure 5
(A) Grayscale distribution of the detector’s target surface at 3 ms and 50 °C, and non-uniformity of each pixel of the correction image, with lens. (B) Grayscale distribution of the detector’s target surface at 3 ms and 50 °C, and non-uniformity of each pixel of the correction image, without lens.
In a stable laboratory environment, the calibration experiment was set up as shown in Figure 6. The blackbody temperature was ramped up from 25 °C to 70 °C at 5 °C intervals, and the gray images corresponding to different integration times at each temperature were acquired. The same blackbody was used throughout the experiment.
Figure 6
(A) Experimental setup for the calibration of the near-extended source (NES) blackbody. (B) Calibration experiment of the simulated baffle blackbody.
The radiance value of the corresponding temperature of the baffle blackbody was fitted with the acquired image grayscale value by the least squares method to obtain the calibration equation (1 ms integration time) given by Equation (12), and the value of was calculated as 1445.80702 (digital number). The fitting curve is shown in Figure 7, and the goodness of fit of the calibration curve is 0.99987; this is also called the coefficient of determination, which represents the degree of fit of the regression line to the observed values. The closer the value is to 1, the higher the degree of explanation of the dependent variable by the independent variable.
Figure 7
Baffle blackbody calibration curve with integration time of 1 ms.
Using Equation (21), the acquired grayscale images in the experiments were data-processed to determine the values of the equivalent calibration conversion function at the corresponding radiance, which are given in Table 3. Based on the calculated results, the mathematical expression of the conversion function was obtained by fitting the radiance to the corresponding value of :
Table 3
Experimental data and calculation of .
Tem./°C
Radiance/W⋅m−2⋅sr−1
DNcl/Digital Number
DNcs/Digital Number
Ec(Tbb)
25
1.17567
2125.09
2131.52
0.99063
30
1.41061
2234.29
2253.64
0.97605
35
1.68279
2364.90
2400.25
0.96296
40
1.99649
2520.64
2574.43
0.95234
45
2.35631
2702.67
2778.50
0.94310
50
2.76712
2914.86
3014.11
0.93672
55
3.23408
3155.04
3283.44
0.93013
60
3.76264
3430.11
3587.63
0.92646
65
4.35851
3738.66
3930.68
0.92272
70
5.02770
4084.60
4314.93
0.91972
The fitting curve is shown in Figure 8, and the goodness of fit is 0.99931. The fitting Equation (22) is consistent with Equation (18), indicating that the data are valid and that the theoretical derivation process is correct and reasonable.
Figure 8
Fitting curve of the equivalent calibration conversion function.
4.2. Imaging Experiments and the Inversion Data
To prove the correctness of the equivalent calibration conversion function (ECCF) of Equation (22), target blackbody images at different temperatures (Figure 9) were acquired, and the inversion of the radiance was performed according to the equivalent calibration of Equation (23), determined by the fitted Equations (19) and (22).
Figure 9
Target blackbody and its imaging at different temperatures.
Meanwhile, as with Equation (22), the calibration of Equation (24) for the external near-extended source (NES) method was determined by fitting the experimental data; the inversion of the radiance of the target image was also performed, and the calibration of Equation (25) of the ECCF method was determined according to Equation (23). The inversion results were analyzed in comparison with the actual radiance corresponding to the blackbody temperature, using two methods.The data are listed in Table 4, and Figure 10 shows a visual comparison of the radiance calculated by the two methods with the actual radiance values of the target. Figure 11 shows the error between the data processed by the external blackbody’s direct calibration method and the data processed by the method proposed in this paper at different temperatures.
Table 4
The inversion data of two calibration methods, and the error between them.
Tem./°C
Radiance/W⋅m−2⋅sr−1
Er./%
Actual
NES
ECCF
37
1.80303
1.73559
1.73502
0.841
42
2.13462
2.03034
2.02998
0.349
47
2.51424
2.37207
2.37194
0.091
52
2.94687
2.76978
2.76992
0.082
57
3.43780
3.22122
3.22168
0.211
Figure 10
Comparison of the inversion radiance of the two methods with the actual radiance of the target.
Figure 11
The errors (1 ms) between the processed data of the two methods.
Equations (24) and (25) are essentially the same. Based on the inversion results in Figure 10 and the inversion errors in Figure 11, they are also consistent; the average error between the two methods is only 0.198%, and the maximum error does not exceed 1%. This shows that it is reasonable to derive an equivalent calibration conversion function for the measurements that can be applied. We calculated the error between the measurement results of the two methods and the actual value, and the maximum did not exceed 7%. The inversion accuracy fully met the requirements of the infrared radiant measurement equipment work, as shown in Table 5. According to the related literature [22,23], the accuracy of infrared radiation characteristic measurement of the target is generally about 15% at present, so 7% is completely acceptable, and the accuracy is relatively high.
Table 5
The error of calculation results of two methods and the actual value.
Tem./°C
NES Error/%
ECCF Error/%
37
3.740
3.772
42
4.885
4.902
47
5.654
5.660
52
6.009
6.005
57
6.300
6.287
In addition, we used the constant scale equivalent conversion function E, calculated at an integration time of 1 ms, to process grayscale images at different integration times; the errors between the calculated results and the actual radiation of the target are listed in Table 6. The maximum error was within 6%.
Table 6
Inversion errors of different integration times between the ECCF method and the actual value.
Tem./°C
Error of Different Integration Times/%
2 ms
3 ms
4 ms
5 ms
37
3.607
3.635
3.580
3.695
42
4.194
4.195
4.168
4.177
47
4.763
4.794
4.719
4.621
52
5.213
5.260
5.214
5.047
57
5.649
5.663
5.585
5.370
The error distribution between the two methods at different integration times and target temperatures is shown in Table 7 and Figure 12. As can be seen from the figure, the error distribution is independent of the integration time, and all of the errors are within 0.6%, indicating that measured at a certain integration time can be generalized to the conversion of the calibration equation for other integration times.
Table 7
The errors of different integration times between the ECCF method and the NES method.
Tem./°C
Error of Different Integration Times/%
2 ms
3 ms
4 ms
5 ms
37
0.024
0.038
0.051
0.078
42
0.090
0.099
0.116
0.113
47
0.144
0.149
0.170
0.271
52
0.190
0.191
0.214
0.403
57
0.228
0.226
0.252
0.514
Figure 12
The error distribution between the ECCF method and the NES method at different integration times.
Finally, we added an experiment. The blackbody baffle was placed in front of the camera for image acquisition, and the blackbody temperature was set to 60 °C. A calibration image was acquired every two minutes for 30 min. The results are shown in Figure 13. It can be seen that the image’s gray value does not change much with time—within 0.3%—indicating that the blackbody heat source has little effect on the temperature change of the internal components of the cooled camera, and the detector response is effectively unchanged. This further illustrates the feasibility of the calibration method for application to radiometric characteristic measurement equipment using a cooled infrared camera.
Figure 13
Image grayscale values over time when the blackbody is set to 60 °C (integration time = 2 ms).
5. Conclusions
This paper presents an idea of replacing the large surface-source blackbody calibration for fieldwork. This is an equivalent calibration conversion method based on an internal blackbody baffle. Based on the calibration model considering the ambient temperature, the specific form of the (equivalent calibration conversion function (ECCF)) was derived. The calibration experiments were performed using a cooled mid-wave infrared camera, the ECCF was measured and calculated, and the proposed method was verified and evaluated by target imaging experiments. The results show that the calibration results of the system achieved by the conversion function are generally consistent with the direct calibration results of the external blackbody, and the error between them is within 1% (1 ms). The error of the inversion results using this method also meets the measurement accuracy with the actual radiance. Therefore, when the equipment is working in the external field, only a small blackbody baffle is needed to calibrate the detector, and using the conversion function, the equivalent results of direct calibration of a large surface-source blackbody covering the aperture of the equipment can be obtained, reducing the workload, working time, and equipment maintenance costs of equipment calibration.