Mahesh B Nagarajan1, Markus B Huber2, Thomas Schlossbauer3, Gerda Leinsinger3, Andrzej Krol4, Axel Wismüller5. 1. Department of Imaging Sciences, University of Rochester, 430 Elmwood Avenue, Rochester, NY 14627, USA; Department of Biomedical Engineering, University of Rochester, 430 Elmwood Avenue, Rochester, NY 14627, USA. Electronic address: mahesh.nagarajan@rochester.edu. 2. Department of Imaging Sciences, University of Rochester, 430 Elmwood Avenue, Rochester, NY 14627, USA; Department of Biomedical Engineering, University of Rochester, 430 Elmwood Avenue, Rochester, NY 14627, USA. 3. Department of Radiology, Ludwig Maximilians University, Klinikum Innenstadt, Ziemssenstr. 1, 80336 Munich, Germany. 4. Department of Radiology, SUNY Upstate Medical University, 750 E. Adams St, Syracuse, NY 13210, USA. 5. Department of Imaging Sciences, University of Rochester, 430 Elmwood Avenue, Rochester, NY 14627, USA; Department of Biomedical Engineering, University of Rochester, 430 Elmwood Avenue, Rochester, NY 14627, USA; Department of Radiology, Ludwig Maximilians University, Klinikum Innenstadt, Ziemssenstr. 1, 80336 Munich, Germany.
Abstract
OBJECTIVE: While dimension reduction has been previously explored in computer aided diagnosis (CADx) as an alternative to feature selection, previous implementations of its integration into CADx do not ensure strict separation between training and test data required for the machine learning task. This compromises the integrity of the independent test set, which serves as the basis for evaluating classifier performance. METHODS AND MATERIALS: We propose, implement and evaluate an improved CADx methodology where strict separation is maintained. This is achieved by subjecting the training data alone to dimension reduction; the test data is subsequently processed with out-of-sample extension methods. Our approach is demonstrated in the research context of classifying small diagnostically challenging lesions annotated on dynamic breast magnetic resonance imaging (MRI) studies. The lesions were dynamically characterized through topological feature vectors derived from Minkowski functionals. These feature vectors were then subject to dimension reduction with different linear and non-linear algorithms applied in conjunction with out-of-sample extension techniques. This was followed by classification through supervised learning with support vector regression. Area under the receiver-operating characteristic curve (AUC) was evaluated as the metric of classifier performance. RESULTS: Of the feature vectors investigated, the best performance was observed with Minkowski functional 'perimeter' while comparable performance was observed with 'area'. Of the dimension reduction algorithms tested with 'perimeter', the best performance was observed with Sammon's mapping (0.84±0.10) while comparable performance was achieved with exploratory observation machine (0.82±0.09) and principal component analysis (0.80±0.10). CONCLUSIONS: The results reported in this study with the proposed CADx methodology present a significant improvement over previous results reported with such small lesions on dynamic breast MRI. In particular, non-linear algorithms for dimension reduction exhibited better classification performance than linear approaches, when integrated into our CADx methodology. We also note that while dimension reduction techniques may not necessarily provide an improvement in classification performance over feature selection, they do allow for a higher degree of feature compaction.
OBJECTIVE: While dimension reduction has been previously explored in computer aided diagnosis (CADx) as an alternative to feature selection, previous implementations of its integration into CADx do not ensure strict separation between training and test data required for the machine learning task. This compromises the integrity of the independent test set, which serves as the basis for evaluating classifier performance. METHODS AND MATERIALS: We propose, implement and evaluate an improved CADx methodology where strict separation is maintained. This is achieved by subjecting the training data alone to dimension reduction; the test data is subsequently processed with out-of-sample extension methods. Our approach is demonstrated in the research context of classifying small diagnostically challenging lesions annotated on dynamic breast magnetic resonance imaging (MRI) studies. The lesions were dynamically characterized through topological feature vectors derived from Minkowski functionals. These feature vectors were then subject to dimension reduction with different linear and non-linear algorithms applied in conjunction with out-of-sample extension techniques. This was followed by classification through supervised learning with support vector regression. Area under the receiver-operating characteristic curve (AUC) was evaluated as the metric of classifier performance. RESULTS: Of the feature vectors investigated, the best performance was observed with Minkowski functional 'perimeter' while comparable performance was observed with 'area'. Of the dimension reduction algorithms tested with 'perimeter', the best performance was observed with Sammon's mapping (0.84±0.10) while comparable performance was achieved with exploratory observation machine (0.82±0.09) and principal component analysis (0.80±0.10). CONCLUSIONS: The results reported in this study with the proposed CADx methodology present a significant improvement over previous results reported with such small lesions on dynamic breast MRI. In particular, non-linear algorithms for dimension reduction exhibited better classification performance than linear approaches, when integrated into our CADx methodology. We also note that while dimension reduction techniques may not necessarily provide an improvement in classification performance over feature selection, they do allow for a higher degree of feature compaction.
Authors: Markus B Huber; Mahesh B Nagarajan; Gerda Leinsinger; Roger Eibel; Lawrence A Ray; Axel Wismüller Journal: Med Phys Date: 2011-04 Impact factor: 4.071
Authors: Mahesh B Nagarajan; Markus B Huber; Thomas Schlossbauer; Gerda Leinsinger; Andrzej Krol; Axel Wismüller Journal: Mach Vis Appl Date: 2013-10-01 Impact factor: 2.012
Authors: Chien-Chun Yang; Mahesh B Nagarajan; Markus B Huber; Julio Carballido-Gamio; Jan S Bauer; Thomas Baum; Felix Eckstein; Eva-Maria Lochmüller; Thomas M Link; Axel Wismüller Journal: Proc SPIE Int Soc Opt Eng Date: 2014-03-13
Authors: Mahesh B Nagarajan; Paola Coan; Markus B Huber; Paul C Diemoz; Axel Wismüller Journal: Med Biol Eng Comput Date: 2015-07-04 Impact factor: 2.602