N Peek1, J H Holmes, J Sun. 1. Niels Peek, Centre for Health Informatics, The University of Manchester, Vaughan House, Portsmouth Street, Manchester M13 9GB, United Kingdom, E-mail: niels.peek@manchester.ac.uk.
Abstract
OBJECTIVES: To review technical and methodological challenges for big data research in biomedicine and health. METHODS: We discuss sources of big datasets, survey infrastructures for big data storage and big data processing, and describe the main challenges that arise when analyzing big data. RESULTS: The life and biomedical sciences are massively contributing to the big data revolution through secondary use of data that were collected during routine care and through new data sources such as social media. Efficient processing of big datasets is typically achieved by distributing computation over a cluster of computers. Data analysts should be aware of pitfalls related to big data such as bias in routine care data and the risk of false-positive findings in high-dimensional datasets. CONCLUSIONS: The major challenge for the near future is to transform analytical methods that are used in the biomedical and health domain, to fit the distributed storage and processing model that is required to handle big data, while ensuring confidentiality of the data being analyzed.
OBJECTIVES: To review technical and methodological challenges for big data research in biomedicine and health. METHODS: We discuss sources of big datasets, survey infrastructures for big data storage and big data processing, and describe the main challenges that arise when analyzing big data. RESULTS: The life and biomedical sciences are massively contributing to the big data revolution through secondary use of data that were collected during routine care and through new data sources such as social media. Efficient processing of big datasets is typically achieved by distributing computation over a cluster of computers. Data analysts should be aware of pitfalls related to big data such as bias in routine care data and the risk of false-positive findings in high-dimensional datasets. CONCLUSIONS: The major challenge for the near future is to transform analytical methods that are used in the biomedical and health domain, to fit the distributed storage and processing model that is required to handle big data, while ensuring confidentiality of the data being analyzed.
Entities:
Keywords:
Big Data; distributed computing; electronic health records; statistical analysis
Authors: Ryen W White; Nicholas P Tatonetti; Nigam H Shah; Russ B Altman; Eric Horvitz Journal: J Am Med Inform Assoc Date: 2013-03-06 Impact factor: 4.497
Authors: Sarah A Marshall; Christopher C Yang; Qing Ping; Mengnan Zhao; Nancy E Avis; Edward H Ip Journal: Qual Life Res Date: 2015-10-17 Impact factor: 4.147
Authors: John Harry Caufield; Dibakar Sigdel; John Fu; Howard Choi; Vladimir Guevara-Gonzalez; Ding Wang; Peipei Ping Journal: Cardiovasc Res Date: 2022-02-21 Impact factor: 13.081