Literature DB >> 33540610

Handling Complex Missing Data Using Random Forest Approach for an Air Quality Monitoring Dataset: A Case Study of Kuwait Environmental Data (2012 to 2018).

Ahmad R Alsaber1, Jiazhu Pan1, Adeeba Al-Hurban2.   

Abstract

In environmental research, missing data are often a challenge for statistical modeling. This paper addressed some advanced techniques to deal with missing values in a data set measuring air quality using a multiple imputation (MI) approach. MCAR, MAR, and NMAR missing data techniques are applied to the data set. Five missing data levels are considered: 5%, 10%, 20%, 30%, and 40%. The imputation method used in this paper is an iterative imputation method, missForest, which is related to the random forest approach. Air quality data sets were gathered from five monitoring stations in Kuwait, aggregated to a daily basis. Logarithm transformation was carried out for all pollutant data, in order to normalize their distributions and to minimize skewness. We found high levels of missing values for NO2 (18.4%), CO (18.5%), PM10 (57.4%), SO2 (19.0%), and O3 (18.2%) data. Climatological data (i.e., air temperature, relative humidity, wind direction, and wind speed) were used as control variables for better estimation. The results show that the MAR technique had the lowest RMSE and MAE. We conclude that MI using the missForest approach has a high level of accuracy in estimating missing values. MissForest had the lowest imputation error (RMSE and MAE) among the other imputation methods and, thus, can be considered to be appropriate for analyzing air quality data.

Entities:  

Keywords:  air quality; high dimensional data; missing data mechanism; missing imputation; random forest

Year:  2021        PMID: 33540610      PMCID: PMC7908071          DOI: 10.3390/ijerph18031333

Source DB:  PubMed          Journal:  Int J Environ Res Public Health        ISSN: 1660-4601            Impact factor:   3.390


  17 in total

Review 1.  Missing data analysis: making it work in the real world.

Authors:  John W Graham
Journal:  Annu Rev Psychol       Date:  2009       Impact factor: 24.137

2.  Random Forest Missing Data Algorithms.

Authors:  Fei Tang; Hemant Ishwaran
Journal:  Stat Anal Data Min       Date:  2017-06-13       Impact factor: 1.051

3.  Robust data imputation.

Authors:  Karlien Vanden Branden; Sabine Verboven
Journal:  Comput Biol Chem       Date:  2008-07-18       Impact factor: 2.877

4.  Imputing cross-sectional missing data: comparison of common techniques.

Authors:  Graeme Hawthorne; Peter Elliott
Journal:  Aust N Z J Psychiatry       Date:  2005-07       Impact factor: 5.744

5.  Influence of pattern of missing data on performance of imputation methods: an example using national data on drug injection in prisons.

Authors:  Saiedeh Haji-Maghsoudi; Ali-Akbar Haghdoost; Azam Rastegari; Mohammad Reza Baneshi
Journal:  Int J Health Policy Manag       Date:  2013-06-03

6.  Missing value imputation in high-dimensional phenomic data: imputable or not, and how?

Authors:  Serena G Liao; Yan Lin; Dongwan D Kang; Divay Chandra; Jessica Bon; Naftali Kaminski; Frank C Sciurba; George C Tseng
Journal:  BMC Bioinformatics       Date:  2014-11-05       Impact factor: 3.169

7.  A concise measure of anger in combat-related posttraumatic stress disorder.

Authors:  David Forbes; Graeme Hawthorne; Peter Elliott; Tony McHugh; Dirk Biddle; Mark Creamer; Raymond W Novaco
Journal:  J Trauma Stress       Date:  2004-06

8.  Recovery of information from multiple imputation: a simulation study.

Authors:  Katherine J Lee; John B Carlin
Journal:  Emerg Themes Epidemiol       Date:  2012-06-13

9.  Avoiding bias due to perfect prediction in multiple imputation of incomplete categorical variables.

Authors:  Ian R White; Rhian Daniel; Patrick Royston
Journal:  Comput Stat Data Anal       Date:  2010-10-01       Impact factor: 1.681

10.  Log-transformation and its implications for data analysis.

Authors:  Changyong Feng; Hongyue Wang; Naiji Lu; Tian Chen; Hua He; Ying Lu; Xin M Tu
Journal:  Shanghai Arch Psychiatry       Date:  2014-04
View more
  4 in total

1.  Ambient Air Pollution and Kawasaki Disease in Korean Children: A Study of the National Health Insurance Claim Data.

Authors:  Dayoon Kwon; Young June Choe; Sun-Young Kim; Byung Chul Chun; Seung-Ah Choe
Journal:  J Am Heart Assoc       Date:  2022-04-27       Impact factor: 6.106

2.  A Dynamic Model for Imputing Missing Medical Data: A Multiobjective Particle Swarm Optimization Algorithm.

Authors:  Peyman Almasinejad; Amin Golabpour; Mohammad Reza Mollakhalili Meybodi; Kamal Mirzaie; Ahmad Khosravi
Journal:  J Healthc Eng       Date:  2021-10-08       Impact factor: 3.822

3.  An interpretable machine learning model based on a quick pre-screening system enables accurate deterioration risk prediction for COVID-19.

Authors:  Lijing Jia; Zijian Wei; Heng Zhang; Jiaming Wang; Ruiqi Jia; Manhong Zhou; Xueyan Li; Hankun Zhang; Xuedong Chen; Zheyuan Yu; Zhaohong Wang; Xiucheng Li; Tingting Li; Xiangge Liu; Pei Liu; Wei Chen; Jing Li; Kunlun He
Journal:  Sci Rep       Date:  2021-11-30       Impact factor: 4.379

4.  Discrete Missing Data Imputation Using Multilayer Perceptron and Momentum Gradient Descent.

Authors:  Hu Pan; Zhiwei Ye; Qiyi He; Chunyan Yan; Jianyu Yuan; Xudong Lai; Jun Su; Ruihan Li
Journal:  Sensors (Basel)       Date:  2022-07-28       Impact factor: 3.847

  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.