| Literature DB >> 34214695 |
Loïc Musy1, Ralph Bulanadi2, Iaroslav Gaponenko3, Patrycja Paruch3.
Abstract
Research in materials science increasingly depends on the correlation of information from multiple characterisation techniques, acquired in ever larger datasets. Efficient methods of processing and storing these complex datasets are therefore crucial. Reliably keeping track of data processing is also essential to conform with the goals of open science. Here, we introduce Hystorian, a generic materials science data analysis Python package built at its core to improve the traceability, reproducibility, and archival ability of data processing. Proprietary data formats are converted into open hierarchical data format (HDF5) files, with both datasets and subsequent workflows automatically stored into a single location, thus allowing easy management of multiple data types. At present, Hystorian provides a basic scanning probe microscopy and x-ray diffraction analysis toolkit, and is readily extensible to suit user needs. It is also able to wrap over any existing processing functions, making it easy to append in an extant workflow.Keywords: Big data; Data processing; Image registration; Piezoresponse force microscopy; Scanning probe microscopy
Year: 2021 PMID: 34214695 DOI: 10.1016/j.ultramic.2021.113345
Source DB: PubMed Journal: Ultramicroscopy ISSN: 0304-3991 Impact factor: 2.689