Literature DB >> 32494311

Brain Activation During Conceptual Processing of Action and Sound Verbs.

Margot Popp1, Natalie M Trumpp1, Eun-Jin Sim1, Markus Kiefer1.   

Abstract

Grounded cognition approaches to conceptual representations postulate a close link between conceptual knowledge and the sensorimotor brain systems. The present fMRI study tested, whether a feature-specific representation of concepts, as previously demonstrated for nouns, can also be found for action- and sound-related verbs. Participants were presented with action- and soundrelated verbs along with pseudoverbs while performing a lexical decision task. Sound-related verbs activated auditory areas in the temporal cortex, whereas action-related verbs activated brain regions in the superior frontal gyrus and the cerebellum, albeit only at a more liberal threshold. This differential brain activation during conceptual verb processing partially overlapped with or was adjacent to brain regions activated during the functional localizers probing sound perception or action execution. Activity in brain areas involved in the processing of action information was parametrically modulated by ratings of action relevance. Comparisons of action- and sound-related verbs with pseudoverbs revealed activation for both verb categories in auditory and motor areas. In contrast to proposals of strong grounded cognition approaches, our study did not demonstrate a considerable overlap of activations for action- and sound-related verbs and for the corresponding functional localizer tasks. However, in line with weaker variants of grounded cognition theories, the differential activation pattern for action- and sound-related verbs was near corresponding sensorimotor brain regions depending on conceptual feature relevance. Possibly, action-sound coupling resulted in a mutual activation of the motor and the auditory system for both action- and sound-related verbs, thereby reducing the effect sizes for the differential contrasts. Copyright:
© 2019 University of Economics and Human Sciences in Warsaw.

Entities:  

Keywords:  action-related concepts; embodied cognition; functional magnetic ; grounded cognition theory; language; resonance imaging; sound-related concepts

Year:  2019        PMID: 32494311      PMCID: PMC7251527          DOI: 10.5709/acp-0272-4

Source DB:  PubMed          Journal:  Adv Cogn Psychol        ISSN: 1895-1171


Introduction

Concepts are important mental building blocks that provide categorical factual knowledge for cognitive functions like language, action, and thought (Humphreys, Price, & Riddoch, 1999; Kiefer & Pulvermüller, 2012). It is generally accepted that concepts, which also constitute the meaning of words, are stored in semantic long-term memory (Tulving, 1972). Despite the general agreement concerning the characterization and function of concepts within semantic memory, their representational format is still a matter of controversial debate (Kiefer & Pulvermüller, 2012). Classical amodal theories propose that conceptual knowledge is represented independent of the sensorimotor systems (Anderson, 1983; McClelland & Rogers, 2003; Pylyshyn, 1980) in an amodal semantic hub, neuroanatomically located within the temporal pole (de Zubicaray, Wilson, McMahon, & Muthiah, 2001; Lambon Ralph, Jefferies, Patterson, & Rogers, 2017; Patterson, Nestor, & Rogers, 2007; Visser, Jefferies, & Lambon Ralph, 2010). The original sensory and motor conceptual information is transformed into an abstract and symbolic representation format. Activation in sensorimotor brain systems in conceptual tasks is seen as concomitant, reflecting semantic elaboration or imagery (Machery, 2007; Mahon, Anzellotti, Schwarzbach, Zampini, & Caramazza, 2009). Challenging this classical view, the grounded cognition framework proposes that access to conceptual knowledge depends on a reenactment of cell assemblies in sensory and motor brain networks, which were also active during former physical experiences with these objects (Barsalou, 2008; Kiefer & Pulvermüller, 2012; Pulvermüller & Fadiga, 2010). Thus, activity in sensory and motor brain regions during conceptual processing is crucially involved in constituting conceptual meaning (De Grauwe, Willems, Rueschemeyer, Lemhofer, & Schriefers, 2014; Hauk, Johnsrude, & Pulvermüller, 2004). For example, conceptual processing of the word to throw activates sensory and motor brain areas that would also be activated during the execution of a throwing action. Grounded cognition theories vary depending on their explanations of the precise relationship between the sensorimotor systems and the conceptual system (for a review, see Meteyard, Cuadrado, Bahrami, & Vigliocco, 2012): While strong grounded cognition accounts assume an identical neural substrate between conceptual and sensorimotor processing including primary and secondary modality-specific cortex (Gallese & Lakoff, 2005; Pulvermüller, 2001), weaker variants of grounded cognition theories assume a hierarchy of neural circuits involving various levels of modality-specific (primary, secondary, or modality-specific association cortex), adjacent higherlevel multimodal cortices, as well as heteromodal semantic hub regions to be involved in the processing of conceptual information (Garagnani & Pulvermüller, 2016; Kiefer, Sim, Herrnberger, Grothe, & Hoenig, 2008; Pulvermüller, 2018; Simmons & Barsalou, 2003). These latter weaker grounded cognition accounts do not claim an identical neural substrate and a functional equivalence of conceptual and sensorimotor processing and can be thus considered as hybrid theories. Although several studies provided evidence for amodal theories (Lambon Ralph et al., 2017; Mahon et al., 2009; Peelen et al., 2013; Striem-Amit, Vannuscorps, & Caramazza, 2017), a growing number of behavioral (Glenberg & Kaschak, 2002; Rueschemeyer, Pfeiffer, & Bekkering, 2010; Shebani & Pulvermüller, 2013), neuroimaging (Hauk et al., 2004; James & Gauthier, 2003; van Dam, van Dijk, Bekkering, & Rueschemeyer, 2012), electrophysiological (Hoenig, Sim, Bochev, Herrnberger, & Kiefer, 2008; Kiefer et al., 2008; Trumpp, Traub, & Kiefer, 2013) and lesion studies (Dreyer et al., 2015; Trumpp, Kliese, Hoenig, Haarmaier, & Kiefer, 2013; Warrington & McCarthy, 1987) support the assumption of a modality-specific representation of conceptual knowledge in line with the grounded cognition framework. Previous neuroimaging studies on object-related nouns showed that visual-related words such as bulldozer activate visual brain regions (Chao & Martin, 1999), sound-related words like telephone activate auditory brain areas (Kiefer et al., 2008; Kiefer et al., 2012), action-related nouns like hammer activate motor and motion-related brain areas (Chao & Martin, 2000; Kiefer et al., 2012), and odor- or taste-related words (cinnamon or salt) activate olfactory or gustatory brain regions (Barros-Loscertales et al., 2012; Damasio, Grabowski, Tranel, Hichwa, & Damasio, 1996; Gonzalez et al., 2006). Although some studies found activity in primary or secondary modality-specific cortex in accordance with strong grounded cognition theories (Hauk et al., 2004), other studies observed activity in modality-specific association areas (Kiefer et al., 2008; Kiefer et al., 2012) or putatively multimodal areas (Fernandino et al., 2016). In electrophysiological experiments, feature-specific event-related potential (ERP) patterns were evoked by action- and sound-related nouns (Kiefer et al., 2008; Pulvermüller, Lutzenberger, & Preissl, 1999; Trumpp, Traub et al., 2013; Trumpp, Traub, Pulvermüller, & Kiefer, 2014). Modality-specific ERP differences were detected starting 200 ms from stimulus onset, indicating a rapid processing of conceptual features and render it unlikely that effects are attributable to imagery (Kiefer et al., 2008). Masked feature priming and repetition priming experiments (Trumpp, Traub et al., 2013; Trumpp et al., 2014), in which the critical prime words could not be consciously identified, revealed a corresponding modulation of feature-specific ERP patterns for sound- and action-related nouns. This suggests that access to conceptual information automatically activates auditory and motor areas. Source analyses of ERP effects of action-related nouns revealed source activity in frontal and parietal brain areas, whereas sources of soundrelated noun ERPs were referred to temporal brain regions (Trumpp, Traub et al., 2013; Trumpp et al., 2014). The causal relation between the sensorimotor systems and conceptual representations has been demonstrated by several lesion studies (Bak et al., 2006; Humphreys & Forde, 2001; Neininger & Pulvermüller, 2003; Pulvermüller et al., 2010; Trumpp, Kliese et al., 2013; Warrington & Shallice, 1984) or studies using transcranial magnetic stimulation (TMS, Buccino et al., 2005; Pulvermüller, Hauk, Nikulin, & Ilmoniemi, 2005). Feature-specific conceptual processing has also been investigated in verbs, in particular in comparison to nouns. Previous studies suggest that nouns have a strong visual-related semantic content (Jones & Smith, 1993; Setti, Caramelli, & Borghi, 2009), whereas verbs have a dominant action-related semantic content (Moseley & Pulvermüller, 2014). Although differences in processing of nouns and verbs might also reflect grammatical category (Bedny, Caramazza, Grossman, Pascual-Leone, & Saxe, 2008; Shapiro & Caramazza, 2003), recent findings substantiated a differential semantic content of nouns vs. verbs independent of lexical category effects (Moseley & Pulvermüller, 2014). However, as indicated above, the meaning of nouns does not only refer to visual semantic features, but also to action and auditory features. It is conceivable that, in an analogue way, verbs are not only constituted by action semantic features but also by visual and auditory semantic features. Several factors, however, render a direct comparison of nouns and verbs difficult. For example, compared to nouns, verbs have a delayed age of acquisition (Gentner, 1982) and are more likely associated with multiple meanings and, therefore, more difficult to process (Ehrlich & Rayner, 1981; Zola, 1984). It is thus important to examine feature-specific effects during conceptual processing within each word class and not between word classes. This also has the advantage to exclude the possibility of different grammatical classes as potential confounds for word category effects. Though some conceptual features might be differentially relevant for nouns versus verbs (e.g., visual features might be more important for nouns than for verbs), grounded cognition theories assume comparable processing of conceptual feature types for both verbs and nouns: Feature-specific processing of both word classes is supposed to be associated with activation in corresponding sensory and motor brain regions (Moseley & Pulvermüller, 2014). However, evidence for feature-specific processing within the category of verbs is relatively scarce and largely based on distinctions between action-related verbs. Some studies on patients with neurodegenerative diseases affecting the motor system reported specific deficits in action-related verb processing (Bak, 2013; Garcia & Ibanez, 2014). Extending these findings, an imaging study showed that effectorspecific action-related verbs (e.g., to kick, to pick or to lick) specifically activate the same motor regions that are activated during real bodypart-specific movements in a somatotopic fashion (Hauk et al., 2004). Another imaging study showed a fine-grained distinction of sensorimotor activations during the processing of different action-related verb categories (Kemmerer, Castillo, Talavage, Patterson, & Wiley, 2008). While feature-specific processing of action- and sound-related words for nouns has been well documented by ERP and fMRI studies, as described above, a similar dissociation for verbs has only been demonstrated by a recent ERP study during a lexical decision task (Popp, Trumpp, & Kiefer, 2016). A comparison between action- and sound-related verbs revealed differential ERP patterns similar to earlier observations with nouns: Action-related verbs elicited more positive scalp potentials within a parietal electrode cluster, whereas soundrelated verbs elicited more negative scalp potentials within a central electrode cluster. Differential ERP effects started early at about 180 ms after stimulus presentation, suggesting that the effects reflect rapid access to auditory and action-related conceptual features. While this earlier ERP study (Popp et al., 2016) tracked the time course of actionand sound-related verb processing with a high temporal resolution, the precise neuroanatomical location of activated brain areas could not been determined. Using the high spatial resolution of functional magnetic resonance imaging (fMRI), the present study aimed at substantiating the notion of modality-specific feature processing within the lexical category of verbs. In particular, this study aimed to test whether processing for action- and sound-related verbs involves a corresponding modalityspecific cortex. We therefore asked whether differential activation patterns for action- and sound-related verbs during an implicit task, which does not foster explicit imagery, were comparable to previous neuroimaging findings on action- and sound-related nouns (Chao & Martin, 2000; Kiefer et al., 2008; Kiefer et al., 2012; Rueschemeyer, van Rooij, Lindemann, Willems, & Bekkering, 2010; Trumpp, Kliese et al., 2013). Therefore, in the present study, we presented our participants with one experimental task and two functional localizer tasks. The first task was a lexical decision task in which participants were presented with action- and sound-related verbs in order to obtain brain activations specific for each feature category. In line with recent theoretical proposals of task-related conceptual flexibility (Hoenig, Sim, Bochev, Herrnberger, & Kiefer, 2008; Pulvermüller, 2018; Sato, Mengarelli, Riggio, Gallese, & Buccino, 2008), implicit tasks such as the lexical decision task, for which retrieval of conceptual information is not directly relevant for task performance, might induce less activation within the modality-specific sensorimotor cortex than tasks requiring explicit semantic retrieval (Binder, Desai, Graves, & Conant, 2009; Kemmerer, 2015). Correspondingly, a direct comparison of explicit versus implicit task revealed a weaker activation of the motor system by action-related verbs during an implicit task (Popp et al., in press; Sato et al., 2008). Although sensorimotor activations during explicit tasks may be stronger, they are also more likely to be confounded by attention to specific conceptual stimulus features (Pulvermüller, 2018) or by additional elaborative semantic processes like explicit semantic retrieval (Binder et al., 2009) or imagery (Chatterjee, 2010). Using an implicit lexical decision task, we were able to investigate the neural correlates of conceptual processing of different feature categories without possible influences of imagery or semantic elaboration processes (Chatterjee, 2010; Machery, 2007). Furthermore, we implemented functional acoustic and motor localizer tasks where participants listened to real sounds or performed real movements, respectively. In order to examine the assumptions of strong grounded cognition approaches, we related activation for action- and sound-related verb processing during the lexical decision task to activation obtained during the acoustic and motor localizer, respectively. Based on the proposals of weaker grounded cognition theories, we assumed that conceptual processing of action- and sound-related verbs activates the same or adjacent sensory and motor areas that are also activated during real sensorimotor experiences. As indicated above, weaker variants of modality-specific theories assume a hierarchy of neural circuits involving various levels of modality-specific (primary, secondary, or modality-specific association cortex) as well as adjacent higher-level multimodal cortices to be involved in the processing of conceptual information (Garagnani & Pulvermüller, 2016; Kiefer et al., 2008; Pulvermüller, 2018; Simmons & Barsalou, 2003). These higherlevel sensorimotor or multimodal areas might not be strongly activated by all types of sensory stimuli in a given modality or by simple motor actions as typically realized in functional localizer tasks, thereby limiting the extent of the potential functional anatomical overlap (for a discussion, see Kiefer et al., 2008). We expected that sound-related verbs would more strongly activate auditory association areas within the left posterior superior and middle temporal gyri than action-related verbs, comparable to previous findings for sound-related nouns (e.g., Kiefer et al., 2008). Action-related verbs should more strongly activate motor and premotor areas than sound-related verbs according to previous findings on action-related nouns (e.g., Rueschemeyer, Pfeiffer, & Bekkering, 2010). Activity in these auditory and motor brain regions should parametrically increase as a function of subjective ratings of sound and action feature relevance (Fernandino et al., 2015; Kiefer et al., 2008). As differential contrasts between action- and sound-related verbs conceal common activity in semantic hub regions such as the anterior temporal lobe as well as in sensorimotor areas, activity to both action-related and sound-related verbs was compared with activity to pseudoverbs. These contrasts control for visual stimulation and motor response, but render the full set of activated conceptual brain areas visible. As the semantic content of action- and sound-related verbs is comprised of both action and sound features, albeit to varying degrees (Popp et al., 2016), both action- and sound-related verbs should elicit greater activity within auditory and motor regions compared with pseudoverbs. Furthermore, in line with weaker grounded cognition accounts (Garagnani & Pulvermüller, 2016; Kiefer et al., 2008; Pulvermüller, 2018; Simmons & Barsalou, 2003), we assume that heteromodal semantic hub regions such as the anterior temporal lobe or the semantic retrieval network, comprised of inferior parietal and inferior frontal areas (Binder, 2016; Binder et al., 2009), are more strongly engaged in the processing of both action- and sound-related verbs compared with pseudoverbs.

Materials and Methods

Participants Twenty-four volunteers (12 females) participated in the study (Mage: 24.09 years). Two subjects were excluded from analyses due to exceeding fMRI head motion parameters (exclusion criteria: translation > +/- 3 mm and/or rotation > +/- 1.5 mm). Final analyses included imaging data of 22 (Mage: 23.9 years, range: 19 – 29 years; 12 female) healthy, right-handed and native German-speaking undergraduates. They had no history of neurological or psychiatric disorders and normal or corrected-to-normal vision. Participants gave written informed consent and obtained 17 € for participation. Procedures were approved by the Ethical Committee of Ulm University. General Procedure Visual stimuli, which were used during the lexical decision task and the motor localizer, were delivered via magnetic resonance-compatible video glasses (Resonance Technology, Los Angeles, CA, USA). They were presented as white letters in the middle of a black background (font size: 16 points character height). Acoustic stimuli of the acoustic localizer task were binaurally presented through magnetic resonance-compatible headphones (Resonance Technology, Los Angeles, CA, USA). Before the fMRI study started, the sound intensity was adjusted individually for each subject (approximately 70 dB). Implementation of the paradigm, stimulus presentation, and behavioral data acquisition were performed within the Experimental Runtime System software package (BeriSoft, Frankfurt, Germany). All participants first performed a lexical decision task followed by the acoustic and the motor localizer. After completing all tasks, structural T1-weighted images were recorded. Participants had the opportunity to practice the lexical decision task outside the scanner using practice stimuli, which were not used in the main experiment and were carefully instructed outside the scanner as well as directly before each task inside the scanner. Preceding the motor localizer task, participants were provided with one elastic hand training ball for each hand. Lexical decision task. In the lexical decision task, the stimulus set contained 40 actionrelated verbs and 40 sound-related verbs in their infinitive form (see Appendix), which were drawn from a previous study (Popp et al., 2016). In this study, stimuli were chosen based on independent conceptual feature ratings on 569 verbs. The verbs were rated by 30 volunteers on a six-point Likert scale (1 - low feature relevance/familiarity; 6 - high feature relevance/familiarity) with respect to their conceptual features (action, sound, visual, emotion) as well as familiarity. The ratings were performed in two questionnaires, given the high number of items: One for conceptual action, sound, and visual feature relevance (“How strongly do you associate the verb with actions/sounds/visual features?”) and the other for emotional feature relevance and the familiarity of the verbs (“How strongly do you associate the verb with emotions?”, “How familiar are you with the verb?”). Fifteen subjects completed each type of questionnaire. Ratings for the different variables were probed in a fixed order. Action- and sound-related verbs (e.g., to throw/to roar) used in the present study had specific high feature ratings of action or sound (i.e., > 4), respectively, and comparable low content of the respective other features. However, action-related verbs had a slight, but significantly higher relevance of visual features than sound-related verbs, p < .008; t(78) = -2.72, presumably due to the importance of visual features for action execution (Johansson, Westling, Backstrom, & Flanagan, 2001; Popp et al., 2016) making a perfect match difficult. Stimuli were carefully matched for psycholinguistic parameters (word length, i.e., number of letters, word frequency, type frequency, lemma frequency, bigram frequency, and trigram frequency) and for familiarity (see Table 1). A complete list of these stimuli is provided in the Appendix. Eighty pronounceable but meaningless pseudoverbs (e.g., spoigen) were additionally created for the lexical decision task by substituting one vowel and one consonant of real verbs that were different from stimuli used in the lexical decision task with another vowel and consonant, respectively. Finally, pseudoverbs were matched with action- and sound-related verbs for word length. Average Values (SD) of Semantic Ratings and Psycholinguistic Stimulus Features for the Critical Action- and Sound-Related Verbs, Together with p-values of Two-Tailed t-Tests. Action- and sound-related verbs as well as pseudoverbs were visually presented once in an event-related design in randomized order. At the beginning of each trial, a fixation cross was presented for 500 ms followed by a verb for 400 ms. Beginning with the onset of the stimulus, participants had to respond within a time window of 1800 ms. Before the next trial started, an intertrial interval (ITI) with a mean duration of approximately 3 s (range: 0–11700 ms) was inserted. A pseudo-randomized sequence of stimulus categories (action-related verb, sound-related verb, or pseudoverb) in dependence of an optimal scanning rate of the hemodynamic response function (Dale, 1999) and the associated ITI was created using OPTSEQ2 (https://surfer.nmr. mgh.harvard.edu/optseq/). Within the fixed sequence of all stimulus categories, the presentation of each verb was randomized for each participant. In the lexical decision task, subjects responded on a response keyboard by pressing the left button with their right index finger to respond to a real verb and by pressing the right button with their right middle finger to respond to a pseudoverb. They were instructed to decide as fast and accurately as possible. The duration of the lexical decision task was approximately 14 minutes and comprised the acquisition of 435 consecutive brain volume images. Functional localizer task.During the acoustic localizer task, two blocks consisting of 10 sounds from natural categories (e.g., barking of dogs) or 10 sounds from manmade categories (e.g., hammer strikes), respectively, were presented together with silence blocks in an alternating order (24 s duration per block). Each sound was binaurally presented with a mean duration of 1468 ms (range: 1050–1980 ms). After sound presentation, a jittered pause was inserted with a mean duration of 932 ms (range: 383–1481 ms). During sound presentation, the screen remained black and participants were instructed to attentively listen to the sounds. The duration of the acoustic localizer was approximately 7 minutes (214 volumes acquired in total). In the motor localizer task, resting and movement blocks were implemented in alternating order similar to the acoustic localizer (24 s duration per block). In the movement blocks, two small arrows were presented in the middle of the screen, which both pointed either to the right or to the left direction. The arrows indicated the respective hand, with which participants had to press an elastic hand training ball. A sequence of 10 arrow pictures was presented, each lasting 300 ms, followed by a clear screen with a mean duration of 2100 ms (range: 1255–2752 ms). Accordingly, participants had to press the hand training ball within one block either 10 times with their right hand or 10 times with their left hand. Participants were instructed to press the ball during the motor localizer task with even strength while keeping the rest of the body motionless. During resting blocks, the arrows were replaced by a fixation cross, whereas the other event parameters were identical. Participants were instructed to look at the fixation crosses. Like the acoustic localizer, the motor localizer task lasted about 7 minutes (214 volumes acquired). Data Acquisition and Analysis For behavioral data, mean reaction times (RTs) for correct responses and mean error rates (ERs) were calculated for each subject and each feature category (sound and action). At the subject level, RTs +/− 2 SDs from the mean value were rejected as outliers. Calculation of ERs comprised wrong and missing responses. Magnetic resonance images were recorded with a 3-tesla scanning system (Siemens Prisma, Erlangen, Germany). Structural T1-weighted images were obtained using a MPRAGE sequence (TR = 2300 ms; TE = 2.32 ms; flip angle = 8°; matrix = 256 × 256; FOV = 240 mm, voxel size = .9 × .9 × .9 mm). Functional T2*-weighted images were recorded by single shot gradient-echo EPI sequence (TR = 2000 ms; TE = 36 ms; flip angle = 90°; matrix = 76 × 76; FOV = 192 mm, voxel size = 2.5 × 2.5 × 2.5 mm). Thirty-two transversal brain slices were recorded in ascending order. Preprocessing and statistical analyses of neuroimaging data were performed using SPM12 (Wellcome Trust Centre for Neuroimaging, London, United Kingdom) running on Matlab R2013b (The MathWorks, Natick, USA). During preprocessing, head motion artifacts were corrected by rigid-body-transformation of all images per series by orienting on the first image for three rotation and three translation parameters. Slice time correction was based on the middle slice and co-registration was performed using structural T1-weighted images for each participant individually. Anatomical structures were normalized to the Montreal Neurological Institute (MNI) template (resampled voxel size: 2 × 2 × 2 mm). Normalized images were smoothed with an isotropic 8 mm FWHM Gaussian kernel. Data were filtered with a temporal high-pass filter (1/128 Hz) and an autoregressive model was used regarding intrinsic temporal autocorrelation of the image series. We performed the fMRI analyses separately for each task. After preprocessing, first-level analyses were performed with the general linear model. The design matrix of the first-level-analyses for the lexical decision task included regressors for sound-related verbs, actionrelated verbs, pseudoverbs, and errors from all conditions, resulting in a design matrix with altogether four experimental regressors and six additional regressors for the motion parameters for each participant. The second-level analysis was specified with a flexible factorial design with subjects as a random factor and the two conditions, action- and sound-related verbs from the first-level analysis, as fixed effects. In order to investigate feature-specific effects, we calculated the t-contrasts between action-related verbs and sound-related verbs and between sound-related verbs and action-related verbs. A statistical threshold of p < .001 (uncorrected) was applied at the voxel level (cluster-forming threshold), and a statistical threshold of p < .05 family-wise error (FEW) corrected for multiple comparisons was applied at the clusterlevel (Eklund, Nichols, & Knutsson, 2016). To investigate action- and sound-specific feature processing independent from verb category, a second analysis was set up including the semantic ratings of acoustic and action verb features as parametric modulators of the canonical hemodynamic response function. This model included verbs, pseudoverbs, and errors as conditions, parametrically modulated by the acoustic and action feature ratings. Pseudoverbs were included as a condition in order to model activity to these stimuli and to keep the analyses comparable, but were not further analyzed. Since pseudoverbs do not have a semantic content and semantic feature ratings are thus not meaningful, a null-vector was inserted. Please note that parametric modulation analyses expect a parametric modulator for all specified regressors, hence also for pseudoverbs. To account for effects of order of the parametric modulators, two models were set up in this analysis. In the first model, the acoustic feature ratings were inserted first and the action feature ratings were inserted second. In the other model, the order was reversed. The second-level analysis was specified with a flexible factorial design with subjects as a random factor and the two parametric modulator acoustic and action feature ratings as fixed effects. For the parametric modulation analysis, we used the identical statistical thresholds as described above. In order to capture activation for verb categories while correcting for visual stimulation and the motor response, a third model was specified in an additional analysis, with a flexible factorial design with subjects as a random factor and the three conditions, action-related verbs, sound-related verbs, and pseudoverbs from the first-level analysis (for results, see Supplementary Table 1). For this third model, as it involved a comparison with pseudoverbs as baseline condition, the statistical threshold of p < .05 FWE-corrected for multiple comparisons was applied at the voxel level (cluster-forming threshold). Functional activations for action- versus sound-related verbs and by sound- versus action-related verbs as well as the comparisons with pseudoverbs were inclusively masked with activations for the respective localizer task (statistical threshold: p < .05 FWE-corrected), in order to reveal common activations. For both functional localizer tasks, sound and action events were timed block-wise and convolved with the canonical hemodynamic response function together with the six motion parameters from realignment (effects of no interest), respectively. Activations for all participants were assessed in a second-level analysis by one-sample t-tests. Sound and movement blocks were compared with the implicit baseline. The statistical threshold for the motor and the acoustic localizer task was set at voxel-level to p < .05 FWE (cluster-forming threshold) corrected for multiple comparisons. Anatomical locations of peak activations of significant clusters were determined by probabilistic cytoarchitectonic mapping using the SPM Anatomy toolbox (Eickhoff et al., 2007).

Results

Behavioral Results Participants performed in the lexical decision task with a mean error rate of 4.6 % (SD = 2.56%). A repeated-measures analysis of variance (ANOVA) revealed that mean ERs differed between action-related verbs (5.45 %; SD = 4.27 %), sound-related verbs (5.91 %; SD = 3.74%), and pseudoverbs (3.52 %; SD = 2.77 %), F(2, 24) = 4.71; p = .014. Significant effects were further analyzed using Tukey’s honestly significant difference (HSD) post-hoc tests. Post-hoc tests showed larger ERs for sound-related verbs than for pseudoverbs, p = .016. Mean ERs between sound and action-related verbs (p = .85) and between actionrelated verbs and pseudoverbs (p = .061) did not significantly differ. A repeated-measures ANOVA on reaction times yielded a significant difference between action-related verbs (687 ms; SD = 93 ms), soundrelated verbs (693 ms; SD = 98 ms) and pseudoverbs (757 ms; SD = 106 ms), F(2, 42) = 50.61; p < .0001. According to post-hoc tests, participants reacted significantly faster to action- and sound-related verbs compared with pseudoverbs (both ps < .001). Reaction times did not significantly differ between action- and sound-related verbs (p = .71). Neuroimaging Results Lexical decision task.For the contrast of sound- versus action-related verbs, we obtained greater activation in the occipital (left inferior, left middle, and right superior occipital lobe and right cuneus), temporal (right inferior, right middle, and bilaterally superior temporal gyrus), and frontal lobe (bilaterally inferior frontal gyrus) regions. The left middle occipital cluster expanded to the inferior parietal gyrus and the postcentral gyrus (see Table 2, Figure 1, Panel B). Contrasting action- versus sound-related verbs revealed no suprathreshold voxels for the applied statistical threshold. However, at a statistical threshold at the cluster level uncorrected for multiple comparisons (p < .05), greater activation in the left superior frontal gyrus and in the right cerebellum was found (see Table 3, Figure 1, Panel A). Peak Activations for the Contrast of Sound- Versus Action-Related Verbs in the Lexical Decision Task. Peak Activations for the Contrast of Action- Versus Sound-Related Verbs in the Lexical Decision Task. Activation peaks during the lexical decision task for verb categories overlaid with activations obtained during the localizer tasks. In order to determine the anatomical vicinity of activations during action execution/sound perception and conceptual processing, activations obtained during the functional localizer tasks were overlaid with activations for the differential contrasts action-related versus sound-related verbs and sound-related versus action-related verbs, respectively. Color range bars indicate T-scores. Overlapping activations are marked in yellow. Panel A: Action-related versus sound-related verbs (green) overlaid with the motor localizer (red). Adjacent activations were found in the right cerebellum, the left superior frontal gyrus and in the white matter. Panel B: Sound-related versus action-related verbs (pink) overlaid with the acoustic localizer (blue). Overlapping activations were bilaterally found in the superior temporal gyrus (left: 12 overlapping voxels, right: 1 voxel). Panel C: Multislice image of overlapping activation for sound-related versus action-related verbs and activations obtained during the acoustic localizer in the left superior temporal gyrus (12 overlapping voxels). Results of action-related versus sound-related verbs are reported at p < .001 (uncorrected) at the voxel level and at p < .05 (uncorrected) at the cluster level and results of sound-related versus action-related verbs are reported at p < .001 (uncorrected) at the voxel level and at a p < .05 FWE corrected at cluster-level. Results of the localizer tasks were reported FWE corrected (p < .05) at the voxel-level. Conceptual acoustic and action feature relevance ratings were related to brain activation during verb processing in parametric modulation analyses. When acoustic ratings were entered first as a parametric modulator and action ratings as a second parametric modulator, greater activity to action versus acoustic ratings was found in the precuneus in both hemispheres and in the left medial fusiform gyrus (see Table 4, Figure 2). The reversed contrast of acoustic versus action ratings revealed no suprathreshold clusters. When the parametric modulators were inserted in the reversed order, no significant results were obtained at the applied statistical threshold. Peak Activations for the Contrast of Action- Versus Acoustic Feature Ratings in the Parametric Modulation Analysis of the Lexical Decision Task. The comparison of sound-related verbs with pseudoverbs revealed activations in several brain areas including middle and superior temporal, occipital, inferior parietal, and inferior frontal cortex. Further activations were found in the cerebellum, the caudate nucleus, the putamen, and the insula (see Supplementary Table 1). Compared with sound-related verbs, pseudoverbs elicited greater activations near the right calcarine sulcus. The comparison of action-related verbs with pseudoverbs also yielded activations in several brain regions comprising the middle and superior temporal, inferior frontal, inferior parietal, and middle occipital cortex. Further activations were found in the cerebellum, the caudate nucleus, the thalamus, the insula, the hippocampus, and the cingulate cortex (see Supplementary Table 1). Compared with action-related verbs, pseudoverbs elicited greater activation in the left precentral gyrus (see Supplementary Table 1). Functional localizer tasks.Comparing sound perception with the implicit baseline, we found bilateral activations in the temporal cortex extending to the insula, with peak activations in the superior temporal gyrus and in the insula in both hemispheres (see Table 5). Masking sound- versus action-related verbs with the results of the acoustic localizer revealed no common activations, which were significant at the cluster level. However, similar to earlier studies, we computed a quantitative overlap between the activations for the conceptual task and the localizer tasks (Hauk et al., 2004; Kiefer et al., 2008; Simmons et al., 2007) at a descriptive level. Activations for the contrast of sound- versus action-related verbs overlapped with the acoustic localizer mainly in the left superior temporal gyrus (12 overlapping voxels). In the right hemisphere, quantitative overlap was nearly absent (one overlapping voxel, see Figure 1, Panels B and C). Activations for the contrast of action- versus sound-related verbs did not overlap with the acoustic localizer. Comparing the execution of hand movements with the implicit baseline revealed activation within the frontal, parietal, temporal, and occipital cortex as well as within the basal ganglia (see Table 5). Masking activations for action- versus sound-related verbs with the results of the motor localizer did not reveal significant common activations at the cluster level. Relating the activations for the contrast of action- versus sound-related verbs (at the more liberal uncorrected threshold) with activations obtained during the motor localizer also did not reveal overlapping clusters. However, activations associated with the processing of action-related verbs border directly on activations for the motor localizer in the right cerebellum (see Figure 1, Panel A). Interestingly, there were common activations for the contrast of sound- versus action-related verbs with the motor localizer (action execution vs. baseline) at the descriptive level in a visual-motor network including frontal, parietal, temporal, and occipital areas (see Supplementary Figure 1). Peak activations for action versus acoustic feature ratings as modulators in the parametric modulation analyses of the lexical decision task. Left: The depicted results were obtained with the model, in which the modulator for acoustic feature ratings was inserted first. The color range bar indicates T-scores. Reported are significant results at a statistical threshold of p< .001 (uncorrected) at the voxel level and at p < .05 (FWE-corrected) at the cluster-level. Right: Effect sizes are depicted for the contributions of conceptual acoustic and action features at the precuneus and the left medial fusiform gyrus. Vertical bars indicate standard error of the mean. Peak Activations for the Acoustic and the Motor Localizer Tasks. Implicitly masking the results of the comparison of sound-related versus pseudoverbs with the acoustic localizer revealed significant common activations in the right superior temporal gyrus. The comparison of action-related versus pseudoverbs masked with the acoustic localizer also yielded common activation in the right superior temporal gyrus (15 commonly activated voxels), however, to a smaller extent compared with masking the results of sound-related verbs versus pseudoverbs (21 commonly activated voxels). The comparisons of pseudoverbs versus sound-related verbs and pseudoverbs versus actionrelated verbs masked with the acoustic localizer revealed no significant overlapping voxels (see Supplementary Table 2, Supplementary Figure 2). Masking analyses of sound-related versus pseudoverbs with the motor localizer revealed significant common activations in middle occipital, middle temporal, and middle cingulate cortex in both hemispheres. The fusiform gyrus, the caudate nucleus, and the precuneus were also commonly activated in both hemispheres. Further common activations were found in the right inferior occipital, the right superior temporal, the left pre- and post-central gyrus, in the left supramarginal gyrus, as well as in the right rolandic operculum, the left insula, and the right putamen. Masking the contrast of action-related verbs versus pseudoverbs with the motor localizer revealed common activations in middle and inferior occipital as well as in the middle and inferior temporal cortex in both hemispheres. Further common activations were found in the right fusiform gyrus, the right superior temporal gyrus, the left posterior medial frontal gyrus, the left paracentral lobule, bilateral precuneus, the left supramarginal gyrus, the right calcarine sulcus, the left mid cingulate cortex, the right rolandic operculum, the caudate nucleus in both hemispheres, the left and right thalamus, and in the left insula. The comparisons of pseudoverbs versus sound-related verbs and pseudoverbs versus action-related verbs masked with the motor localizer revealed no significant overlapping voxels (see Supplementary Table 2, Supplementary Figure 2).

Discussion

In the present fMRI study, we investigated brain activation during the processing of action- and sound-related verbs during a lexical decision task, a task that implicitly probes semantic processing. Sound-related verbs bilaterally elicited activations in the superior temporal cortex, partially overlapping with activation during the perception of real sounds obtained in the functional localizer in the left hemisphere, although formal masking analyses did not yield a significant common activation. Sound-related verbs elicited, in addition to this auditory area, activation in the visual and motor areas. Action-related verbs recruited motor regions within the frontal cortex and the cerebellum, albeit only at a more liberal statistical threshold. These activations in response to action-related verbs were partly located in vicinity (i.e., < 14 mm apart, Sepulcre et al., 2010) of activations obtained during the execution of real movements obtained in the functional localizer. Given that activation for action-related verbs was only found at a more lenient statistical threshold, our findings only partially support the view of grounded cognition theories that sensorimotor systems are involved in semantic word processing (Barsalou, 2008; Gallese & Lakoff, 2005; Kiefer & Pulvermüller, 2012; Martin, 2007). The present study confirms the previous observation of differential ERP effects for action- and sound-related verbs using the same stimulus set (Popp et al., 2016). This earlier study revealed feature-specific ERP effects to action- versus sound-related verbs already at about 110 ms after verb onset. This ERP effect indicates that feature-specific activation indexes rapid access to conceptual features and not later strategic semantic processing or imagery. The present fMRI study provides precise anatomical information for the neural generators underlying the scalp ERP effects and demonstrates an involvement of brain regions within or close to sensory and motor areas in these feature-specific effects. The functional localizer tasks revealed activations in the expected modality-specific brain areas. Peak activations obtained during the motor localizer task were mainly located in the motor cortex, the primary somatosensory cortex and visuo-motor coordination areas within the cerebellum, occipital visual areas, and in motor areas of parietal cortex (Brown, Kessler, Hefter, Cooke, & Freund, 1993; Georgopoulos & Grillner, 1989; Glickstein, 2000;Hauk et al., 2004; Jeannerod, Arbib, Rizzolatti, & Sakata, 1995; Lotze et al., 1999). The perception of real sounds during the acoustic localizer task was associated with activations in the primary and secondary auditory cortex as well as in the auditory association cortex within the superior temporal gyrus (Belin, Zatorre, Lafaille, Ahad, & Pike, 2000; Leaver & Rauschecker, 2010; Lewis et al., 2004). Processing of action- versus sound-related verbs in the lexical decision task was associated with activations in the cerebellum and in the superior frontal gyrus, however, only at a more liberal statistical threshold uncorrected for multiple comparisons. Activation in the cerebellum bordered directly on cerebellar activations obtained during the motor localizer, but was not overlapping. Activation in the left superior frontal cortex by action-related verbs during the lexical decision task in the present work is located close to premotor cortex and has also been described in a previous study (Willems, Toni, Hagoort, & Casasanto, 2010). A region of interest (ROI) analysis of the present data at the peak coordinates obtained in this earlier study (x: −14, y: 34, z: 54; spherical ROI with 8 mm radius) revealed higher activity for action- than for sound-related verbs, t(21) = 1.89; p < .05, one-tailed. Voxels of this superior frontal cluster caudally reached into the presupplementary motor area, a cortical region that is involved in several motor functions like motor selection and planning of movements (Kim et al., 2010) or awareness of action discrepancy (Farrer et al., 2008). Previous studies also demonstrated that the dorsolateral part of the superior frontal gyrus is, amongst others, functionally connected to the precuneus and the posterior cingulate cortex (Li et al., 2013), regions that are known to be involved in the retrieval of object-related action information (Wang et al., 2019). This indicates that the superior frontal gyrus is involved in action processing. However, greater activation for action- versus sound-related verbs was only detected, when lowering the statistical threshold at the cluster level. This is partly owed to the fact that sound-related verbs elicited considerable activity within motor areas (see Supplementary Figure 1 and the discussion below), thereby reducing feature-specific effects for action-related verbs. Thus, the validity of the contrast of action- versus sound-related verbs to investigate feature-specific effects for action-related verbs is limited. This suggests that conceptual feature ratings provide only an approximate quantitative estimate of the semantic content of words and linked concepts. Furthermore, the motor response of the button press could have influenced motor activation for action-related verbs by interfering with feature-specific processing of conceptual action-related information (Pulvermüller, 2018; Schomers & Pulvermüller, 2016). This is also indicated by the increased activation in motor areas for pseudoverbs compared to real verbs. Possibly, a task without a concomitant motor response would yield stronger activity to action-related verbs in motor areas as observed previously (Carota, Moseley, & Pulvermüller, 2012; Kemmerer, 2015; Schomers & Pulvermüller, 2016). Sound- versus action-related verb processing elicited activations in a network of auditory, but also of visuo-motor areas. Sound-related verbs activated auditory association areas in the middle temporal gyrus and the superior temporal gyrus, in vicinity of activations obtained in previous studies on sound-related nouns (Kiefer et al., 2008; Kiefer et al., 2012). However, the anatomical location of the present activation was somewhat more superior and posterior than in these previous studies (Kiefer et al., 2008;Kiefer et al., 2012). Other studies on processing of perceptual or conceptual sound-related information found activations in the left posterior superior temporal gyrus in close vicinity to the presently observed activations (e.g., Kellenbach, Brett, & Patterson, 2001;Lewis et al., 2004). Activation in response to conceptual, but also to perceptual sound-related information in posterior temporal cortex appears to be variable to some extent. Possibly, these variations in the precise anatomical locus of higher-level sound processing in posterior temporal areas are due to word class differences or differences in the spectral properties of the sounds, to which the concepts refer (sounds caused by actions vs. sounds elicited by objects). In the present study, activation for sound-related verbs partially overlapped with activity during the acoustic localizer within the superior temporal gyrus, although the masking analysis did not yield significant common activations at the cluster level due to the small cluster size (12 voxels) of the overlapping activation. It should be noted at this place that the size of the overlapping cluster was comparable with the earlier study on sound-related nouns (Kiefer et al., 2008). Furthermore, several earlier studies in the field of grounded cognition (Hauk et al., 2004; Hoenig et al., 2011; Kemmerer et al., 2008; Kiefer et al., 2008; Simmons et al., 2007) only determined a quantitative overlap between conceptual and sensorimotor processing without demonstrating common activations in a conjunction or masking analysis. In support of a functional role of this posterior superior temporal region in higher-level sound processing, a previous study on sound perception and sound imagery also reported activation in this area (Bunzeck, Wuestenberg, Lutz, Heinze, & Jancke, 2005). A formal ROI analysis of the present data based on the peak coordinate from this earlier study (Bunzeck et al., 2005) in the left posterior superior temporal gyrus (x: −52, y: −36, z: 20; spherical ROI with 8 mm radius) revealed a significantly higher magnetic resonance signal for sound than for action -related verbs, t(21) = 1.75; p < .05, one-tailed. Further activations for sound-related verbs were observed in the inferior frontal gyrus and in visuo-motor coordination areas within the parietal and occipital brain regions, which are known to be involved in visuo-motor control (Georgopoulos & Grillner, 1989; Glickstein, 2000). Sound-related verbs might have induced activation in motor regions due to their salient action content. A closer look at the conceptual feature ratings (see Table 1) of sound-related verbs reveals that sound-related verbs also had a relatively high action feature relevance, in addition to a high acoustic feature relevance. For example, the verb to knock has a strong association with sound, but at the same time implies a certain action that is essential for generating the sound. In fact, a recent study provided evidence for such an action-sound coupling leading to mutual activation of the auditory and motor systems (Lemaitre et al., 2018). This linkage between sound and action may explain why sound-related verbs elicited stronger activations in parietal and frontal motor areas than action-related verbs, in addition to greater activity in auditory areas of the temporal cortex: It is possible that action-sound coupling leads to an amplification of activation within the motor system through input from the auditory system, which was absent in action-related verbs. This additional input from auditory areas may have resulted in even stronger activity in various parts of the motor system for sound than for action-related verbs. Relating activations for sound- versus actionrelated verbs to activations obtained during the motor localizer indicated that processing of sound-related verbs involved areas also activated by executing hand movements (see Supplementary Figure 1). Hence, activity to sound-related verbs outside auditory temporal areas most likely does not arise from unspecific or amodal word processing, but reflects sound-related action processing. In support of this interpretation, earlier studies on sound-related nouns also revealed activity not only in auditory areas, but also in motor-related regions of the parietal cortex (Kiefer et al., 2008; Trumpp, Traub et al., 2013; Trumpp et al., 2014). With regard to this action-sound-coupling in sound-related verbs (Lemaitre et al., 2018), which could not be completely bypassed by matching the conceptual stimulus features, a stimulus category other than sound-related verbs might provide a better contrast to investigate feature-specific activations for action-related verbs. To investigate the activation of actionand sound-related verbs during the lexical decision task as a function of acoustic and action feature ratings, parametric modulation analyses were conducted. For the model in which the modulator for acoustic feature ratings was inserted first, significant activation for the contrast of action versus acoustic feature ratings was found in the precuneus and the medial fusiform gyrus. While the precuneus is connected to motor brain regions and associated with processing object-related action information (Wang et al., 2019), the medial fusiform gyrus has been implicated in the representation of manipulable tools (Martin & Chao, 2001). This indicates a role of the precuneus and the medial fusiform gyrus in the processing of conceptual action-related information. Results of the parametric modulation analyses revealed a contribution of action-related brain areas to action-related verb processing, even though these effects were not visible in the differential contrasts of action- versus sound-related verbs. For sound ratings, we failed to find a significant relation to brain activity. This might be explained by the more dichotomous distribution of sound ratings compared with the more continuous distribution of action ratings. The distribution of the former ratings might have prevented significant parametric modulation effects. A parametric modulation effect for action ratings was only found when acoustic feature ratings were entered as the first modulator and action feature ratings as the second modulator. Possibly, due to the mutual influence of acoustic and action feature ratings based on action-sound-coupling (Lemaitre et al., 2018) on brain activity, the parametric modulation effect of action feature ratings is only visible when the influence of acoustic ratings is removed by entering it as first modulator. It is also noteworthy that error rates and reaction times for actionand sound-related verbs did not differ significantly in the present study. This indicates that the verb sets exhibited a comparable level of difficulty. Although we matched our stimuli with regard to conceptual stimulus features, it was not possible to keep the visual content of action-related verbs at a comparable low level as for sound-related verbs. This was owed by the fact that action-related verbs consistently had a relatively high visual feature relevance because actions are typically associated with visual properties of objects or situations (Tyler & Moss, 2001). We had to accept this increased visual feature content of action-related verbs to avoid selection of untypical word material. In order to capture activation for verb categories, while correcting for visual stimulation and the motor response, activations for action- and sound-related verbs were compared with activations for pseudoverbs and inclusively masked with both functional localizers. The comparison with pseudoverbs demonstrates that both verb categories elicit partially similar activations. Both action- and sound-related verbs versus pseudoverbs activated not only general language areas (Binder et al., 2009) but also auditory and motor brain areas, possibly due to action-sound coupling (Lemaitre et al., 2018). Masking analyses revealed activations for soundrelated verbs versus pseudoverbs masked with the acoustic localizer in the superior temporal gyrus (21 commonly activated voxels) to be somewhat more prominent than activations in the same brain area by action-related verbs (15 commonly activated voxels). Masking analyses with the motor localizer revealed that both verb categories also activated a more posterior part of the superior/middle temporal gyrus as shown in previous studies on action- versus sound-related concepts (Kiefer et al., 2012). This activity in auditory and action-related areas was specific for action- and sound-related verbs because processing pseudoverbs did not recruit these areas in the present study. Hence, both verb categories elicited significant activation in auditory and motor areas, in support of grounded cognition theories. This common sensorimotor activation for both verb categories explains why differential contrasts did not yield significant clusters in the corresponding modality-specific cortex. Findings of the present study parallel results of earlier studies on action- and sound-related nouns in many respects, as shown above, although feature-specific activation for action-related verbs was relatively weak and only obtained at a more liberal statistical threshold. As demonstrated by the comparisons with the pseudoverbs, activations found in the differential contrasts of action- versus sound-related verbs and vice versa showed small effect sizes because both verb categories elicited considerable activations in the auditory and motor areas. Nevertheless, the present study shows that category-specific effects for conceptual feature types can also be obtained for verbs. The present results at least partially confirm the assumption of a modality-specific representation of action and sound features for concepts expressed by verbs similar to previous findings on action- and sound-related nouns (Kiefer et al., 2008;Kiefer et al., 2012; Moseley & Pulvermüller, 2014; Rueschemeyer, van Rooij et al., 2010). However, as only differential contrasts between action- and soundrelated verbs as well as between verbs and pseudoverbs were calculated, activation of the anterior temporal lobe, an area presumably involved in amodal conceptual integration, was not revealed by these analyses. Possibly semantic retrieval processes in this area might contribute to the processing of both verbs and pseudoverbs (Kutas & Van Petten, 1994). Therefore, the present study does not preclude the existence of a heteromodal semantic hub in the anterior temporal lobe, which integrates information from different modalities in addition to modality-specific systems (Lambon Ralph et al., 2017). However, greater activity to both verb categories versus pseudoverbs was observed in presumably heteromodal regions of the inferior frontal and inferior parietal cortex (see Supplementary Table 1). These regions can also be considered as semantic hub regions, because they are parts of a frequently documented semantic retrieval network (Binder, 2016; Binder et al., 2009). As neuroimaging studies only provide correlational evidence, the present findings do not rule out that sensorimotor activations during conceptual processing are just epiphenomenal (Mahon & Caramazza, 2003). A functional relation between the sensorimotor systems and conceptual processing could be tested in future studies in behavioral interference paradigms (Klepp et al., 2017; Shebani & Pulvermüller, 2013; Vermeulen, Corneille, & Niedenthal, 2008), transcranial magnetic stimulation (Buccino et al., 2005; Pulvermüller et al., 2005) or lesion studies (Kemmerer, Rudrauf, Manzel, & Tranel, 2012; Neininger & Pulvermüller, 2003; Trumpp, Kliese et al., 2013). The present fMRI results with action- and sound-related verbs are similar, but not identical to findings with corresponding noun categories. Activation for sound-related verbs in the present study was found in a slightly different anatomical location in the posterior temporal cortex than for sound-related nouns (cf.: x: −62, y: −42, z: − 3) in the earlier study (Kiefer et al., 2008). As already discussed above, it must remain open whether this difference reflects word category, spectral properties of the sounds to which the concepts refer, or interindividual anatomical variation. Furthermore, processing of sound-related verbs elicited substantial activity in action-related brain areas, which can be explained by the relatively high action feature content of sound-related verbs. It might be possible that the processing of visually presented actionrelated verbs is more akin to activations for action observation than the actual execution of real movements (Rueschemeyer, Ekman, van Ackeren, & Kilner, 2014). Rueschemeyer et al. (2014) argue that reading actionrelated words is more similar to action observation rather than to the actual execution of movements. Therefore, it is conceivable that activation during a localizer, which requires the observation of action, shows a better functional anatomical overlap with activations elicited by action-related verb processing as compared to the present localizer involving real movements. Furthermore, a greater functional anatomic overlap could also be possibly obtained by using a localizer requiring different object-directed hand actions. Similarly, the acoustic localizer only included a small variety of sounds, which could have limited overlapping activations with processing of sound-related verbs in the temporal cortex. Future studies could therefore test the possibility that the functional-anatomical overlap between conceptual and sensorimotor processing depends on the stimuli and actions used in the localizer tasks. As described in the introduction, only strong grounded cognition theories (Gallese & Lakoff, 2005; Pulvermüller, 2001) assume a full equivalence of the neural substrate of conceptual and sensorimotor processing. Weaker variants of grounded cognition theories, however, assume a hierarchy of neural circuits involving various levels of modalityspecific (primary, secondary, or modality-specific association cortex), adjacent multimodal cortices as well as heteromodal semantic hub areas to be involved in the processing of conceptual information (Garagnani & Pulvermüller, 2016; Kiefer et al., 2008; Pulvermüller, 2018; Simmons & Barsalou, 2003). Hence, these weaker variants of grounded cognition theories predict activation in a conceptual task to be close to or overlapping with a region involved in sensory- or motor processing but do not necessarily imply a full or considerable anatomical overlap. Reactivation of sensorimotor experiences during conceptual processing in implicit tasks requiring only superficial access to semantics might predominantly take place in parts of higher-level sensory and motor association areas as well as adjacent multimodal areas in addition to semantic hub regions. Higherlevel modality-specific and multimodal areas might not be strongly activated by the functional localizer tasks, thereby limiting the extent of the potential functional anatomical overlap. Future studies could test whether the overlap between conceptual and sensorimotor processing would be more extended when a more explicit semantic task such as a categorization (Kemmerer, 2015) or property verification task (Simmons, Hamann, Harenski, Hu, & Barsalou, 2008) is administered instead of the implicit lexical decision task in the present study.

Conclusions

The present study obtained differential activations for action- and sound-related verbs in an implicit lexical decision task. Featurespecific brain activation for action- and sound-related verbs partly overlapped with or was near to brain regions involved in action or perception. It should be noted that comparisons of action- and sound-related verbs with pseudoverbs revealed activation for both verb categories in auditory and action-related areas, presumably due to action-sound coupling (Lemaitre et al., 2018). The present results contradict strong variants of grounded cognition theories (Gallese & Lakoff, 2005; Pulvermüller, 2001), in which an identical neural substrate of conceptual and sensorimotor processing is assumed. However, the present findings are compatible with weaker variants of grounded cognition theories (Garagnani & Pulvermüller, 2016; Kiefer et al., 2008; Pulvermüller, 2018; Simmons & Barsalou, 2003): Our study suggests that conceptual processing depends on a hierarchy of neural circuits involving various levels of modality-specific or adjacent higher-level multimodal cortices supporting representation of action and sound features. Processing in these feature-specific neural circuits is most likely complemented by heteromodal semantic hub regions, which integrate distributed conceptual information.

Appendix

Stimulus Lists

Supplementary Material

Peak Activations for the Comparisons of Action- and Sound-Related Verbs with Pseudoverbs in the Lexical Decision Task. Peak Activations for the Comparisons of Action- and Sound-Related Verbs with Pseudoverbs in the Lexical Decision Task Inclusively Masked with the Functional Localization. Activations for sound-related versus action-related verbs overlaid with activations obtained during the motor localizer. In order to determine the anatomical vicinity of activations during action execution/sound perception and conceptual processing, activations obtained during the functional localizer tasks were overlaid with activations obtained from the differential contrasts action-related versus sound-related verbs and sound-related versus action-related verbs, respectively. Overlapping activations are colored in yellow. Color range bars indicate T-scores. For sound versus action verbs, cluster p was set to < .001 (uncorrected) at the voxel level and p < .05 (FWE-corrected) at the cluster level. Activations for sound-related verbs versus pseudoverbs and for action-related verbs versus pseudoverbs inclusively masked with the functional localizers. As masking analyses with the acoustic localizer only revealed common activations in the right hemisphere, to facilitate comparisons, this figure displays only right hemisphere activity for the masking analyses including the motor localizer. Left hemisphere activation in the masking analyses with the motor localizer can be found in Supplementary Table 2. Panel A: Soundrelated verbs versus pseudoverbs masked with the acoustic localizer. Panel B: Action-related verbs versus pseudoverbs masked with the acoustic localizer. Panel C: Sound-related verbs versus pseudoverbs masked with the motor localizer. Panel D: Action-related verbs versus pseudoverbs masked with the motor localizer. For the differential contrasts and the functional localizer tasks, the statistical threshold was set to p < .05 FWE-corrected at the voxel level.
  4 in total

Review 1.  Neural correlates of embodied action language processing: a systematic review and meta-analytic study.

Authors:  Chiara Giacobbe; Simona Raimo; Maria Cropano; Gabriella Santangelo
Journal:  Brain Imaging Behav       Date:  2022-06-27       Impact factor: 3.224

2.  Cortical presentation of language functions in patients after total laryngectomy: a fMRI study.

Authors:  Aleksandra Wypych; Małgorzata Wierzchowska; Paweł Burduk; Elżbieta Zawada; Katarzyna Nadolska; Zbigniew Serafin
Journal:  Neuroradiology       Date:  2020-04-06       Impact factor: 2.804

3.  Motor features of abstract verbs determine their representations in the motor system.

Authors:  Xiang Li; Dan Luo; Chao Wang; Yaoyuan Xia; Hua Jin
Journal:  Front Psychol       Date:  2022-08-30

4.  Task-Dependent Functional and Effective Connectivity during Conceptual Processing.

Authors:  Philipp Kuhnke; Markus Kiefer; Gesa Hartwigsen
Journal:  Cereb Cortex       Date:  2021-06-10       Impact factor: 5.357

  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.