INTRODUCTION: The healthcare environment is constantly changing. Probabilistic clinical decision support systems need to recognize and incorporate the changing patterns and adjust the decision model to maintain high levels of accuracy. METHODS: Using data from >75,000 ED patients during a 19-month study period we examined the impact of various static and dynamic training strategies on a decision support system designed to predict hospital admission status for ED patients. Training durations ranged from 1 to 12 weeks. During the study period major institutional changes occurred that affected the system's performance level. RESULTS: The average area under the receiver operating characteristic curve was higher and more stable when longer training periods were used. The system showed higher accuracy when retrained an updated with more recent data as compared to static training period. DISCUSSION: To adjust for temporal trends the accuracy of decision support systems can benefit from longer training periods and retraining with more recent data.
INTRODUCTION: The healthcare environment is constantly changing. Probabilistic clinical decision support systems need to recognize and incorporate the changing patterns and adjust the decision model to maintain high levels of accuracy. METHODS: Using data from >75,000 ED patients during a 19-month study period we examined the impact of various static and dynamic training strategies on a decision support system designed to predict hospital admission status for ED patients. Training durations ranged from 1 to 12 weeks. During the study period major institutional changes occurred that affected the system's performance level. RESULTS: The average area under the receiver operating characteristic curve was higher and more stable when longer training periods were used. The system showed higher accuracy when retrained an updated with more recent data as compared to static training period. DISCUSSION: To adjust for temporal trends the accuracy of decision support systems can benefit from longer training periods and retraining with more recent data.
Authors: Daniel J France; Scott Levin; Robin Hemphill; Kong Chen; Dorsey Rickard; Renee Makowski; Ian Jones; Dominik Aronsky Journal: Int J Med Inform Date: 2005-10 Impact factor: 4.046