Investigating naturalistic decision making in a simulated microworld: what questions should we ask?

Computer-simulated microworlds can provide a controlled method for investigating concepts related to naturalistic decision making (NDM). However, the extent to which these tools can be used to generate meaningful outcomes is unknown. The current study used a microworld called Networked Fire Chief (NFC) to explore the range of skills and knowledge acquired as participants gained practice on the program. The complexity of the NFC NDM environment was also explored. Twenty participants each completed 20 equivalent 5-min scenarios on NFC. Interview data, behavioral data and performance scores were collected across the trials. Results confirmed that NFC provides an environment that promotes appropriate perceptual-cognitive processing for NDM. However, performance improved to only a small extent across the 20 trials in four performance areas: speed, accuracy, efficiency and planning. In addition, the number of personal and situational factors to be considered when decision making on NFC was not comparable with real-world NDM environments. Overall, results indicated that the use of microworlds for research should be regulated by an understanding of the limitations of their applicability.