Integration and visualization of multimodality brain data for language mapping.

A goal of the University of Washington Brain Project is to develop software tools for processing, integrating and visualizing multimodality language data obtained at the time of neurosurgery, both for surgical planning and for the study of language organization in the brain. Data from a single patient consist of four magnetic resonance-based image volumes, showing anatomy, veins, arteries and functional activation (fMRI). The data also include the location, on the exposed cortical surface, of sites that were electrically stimulated for the presence of language. These five sources are mapped to a common MR-based neuroanatomical model, then visualized to gain a qualitative appreciation of their relationships, prior to quantitative analysis. These procedures are described and illustrated, with emphasis on the visualization of fMRI activation, which may be deep in the brain, with respect to surface-based stimulation sites.