Literature DB >> 30042854

Contextual cueing of visual search is associated with greater subjective experience of the search display configuration.

Bernhard Schlagbauer1,2, Manuel Rausch1,2,3, Michael Zehetleitner1,3, Hermann J Müller1,4, Thomas Geyer1.   

Abstract

Visual search is facilitated when display configurations are repeated over time, showing that memory of spatio-configural context can cue the location of the target. The present study investigates whether memory of the search target in relation to the configuration of distractors alters subjective experience of the visual search target and/or the subjective experience of the display configuration. Observers performed a masked localization task for targets embedded in repeated vs. non-repeated (baseline) arrays of distractors items. After the localization response, observers reported their subjective experience of either the target or the display configuration. Bayesian analysis revealed that repeated displays resulted in a stronger visual experience of both targets and display configurations. However, subsequent analysis showed that repeated search displays increased the correlation between the experience of the display configuration and localization accuracy, but there was no such effect on experience of the target stimulus. We suggest that memory of visual context enhances the representation of the current visual search display. This representation improves visual search and at the same time increases observers' subjective experience of the display configuration.

Entities:  

Keywords:  contextual cueing; implicit learning; perception; subjective experience; visual search

Year:  2018        PMID: 30042854      PMCID: PMC6007139          DOI: 10.1093/nc/niy001

Source DB:  PubMed          Journal:  Neurosci Conscious        ISSN: 2057-2107


Introduction

In everyday scenes, visual search targets do not appear in isolation but are embedded within configurations of non-target or distractor objects. When observers encounter a target consistently embedded within a stable spatial configuration of distractors, target detection becomes more efficient over time, because incidentally learned configurations expedite visual search, an effect referred to as contextual cueing (Chun and Jiang 1998; Chun 2000). A controversial issue in research on contextual cueing is whether the effect is implicit or explicit (Chun and Jiang 2003; Smyth and Shanks 2008; Schlagbauer ; Vadillo ; Colagiuri and Livesey 2016). The present study investigated a new aspect of awareness in contextual cueing, namely, whether learned spatial contexts modulate subjective experience of the display configuration in addition to subjective experience of the target item.

Contextual cueing of visual search

In their pioneering study, Chun and Jiang (1998) asked their observers to search for a T-shaped target amongst L-shaped distractor items. Unknown to observers, the spatial configurations of targets and distractors were repeated in half of the trials, while in so-called non-repeated displays, shown in the other half of trials, only the locations of targets were held constant across repetitions. Thus, the effects of target location repetition (see e.g. Jiang ; Schlagbauer et al. 2014) were equated across the two types of displays and differences in search performance could only be attributed to the effects of repeated distractor configurations. Reaction times (RTs) decreased with more practice on the experimental task, but this effect was larger for repeated compared to non-repeated displays (=contextual cueing effect). As observers’ ability to recognize repeated displays was only at chance level, Chun and Jiang (1998) concluded that contextual cueing is an implicit effect. However, in recent years the question whether the cueing effect is inaccessible to awareness has become a controversial issue. For instance, a meta-analysis of performance in recognition tasks demonstrated that participants in contextual cueing experiments perform above-chance level (Vadillo ), suggesting that previous non-significant results were likely due to insufficient statistical power of the individual recognition tasks. These observations are consistent with theories according to which all learning processes are associated with some degree of awareness, including repeated displays (Smyth and Shanks 2008). However, a follow-up study again challenged the view of a single memory system in contextual cueing of visual search (Colagiuri and Livesey 2016). The authors used large samples and found that contextual cueing was associated with weaker, not stronger, recognition of learned visual search displays. This led Colagiuri and Livesey (2016) to surmise that contextual cueing is supported by an implicit memory system.

Contextual cueing and subjective visual experience

In the present article, we investigate whether context memory has the capability to affect other processes than visual search, specifically, whether it influences observers’ subjective experience of visual properties of the current search displays. Contextual cueing may influence subjective visual experience in at least two distinct ways. First, context memory might alter the subjective visual experience (“clarity”) of the configuration of display elements. Previous studies showed that when observers are presented with repeated display configurations, they learn to associate the target with the entire configuration of distractor elements (Jiang and Wagner 2004), though target-context associations are particularly strong for distractors in close spatial proximity of the target (Brady and Chun 2007). When the repeated search displays are encountered later on, spatio-configural memory representations make visual search more efficient, for example, by guiding attention faster towards the target location (Johnson ). Crucially, at the same time, these context representations could also enhance observers subjective experience of the display configuration. For instance, observers might feel that they see a clearer configuration of display elements when these configurations are stored in context memory. However, contextual cueing could also reduce subjective experience of the configuration, as previous studies could not rule out a reversed, that is, negative relationship between context learning in visual search and the conscious recollection of the repeated displays (Colagiuri and Livesey 2016). Second, contextual cueing might also influence the subjective visual experience of the target stimulus. The reason for this hypothesis is that contextual cueing can speed up processes after visual selection, for example, the perceptual analysis of the target (which is necessary for performing a discrimination task; see Töllner ) and/or response selection (Kunar ; Hout and Goldinger 2012). Because context memory influences later stages of the search process, it could be expected that these processes do not alter visual experience of the display configuration, but instead increase subjective experience associated with the target stimulus. In other words, context memory may exert a specific influence on observers’ experience of the target stimulus.

Measuring subjective visual experience by verbal reports

Even though objective measures of memory had dominated cognitive psychology for many years (Boring 1953; Eriksen 1960), many researchers from different theoretical perspectives have argued for measuring conscious experience using subjective measures (Dehaene and Naccache 2001; Ramsøy and Overgaard 2004; Lau 2008; Seth ). One approach based on subjective measures is to ask observers about their confidence in being correct, because it can be expected that participants determine their confidence judgement on the basis of all information they are aware of and consider as relevant for performing the task (Dienes and Seth 2010). A second approach is to ask observers directly to introspect and report their conscious experience. The most frequently used scale is the “Perceptual Awareness Scale,” which requires observers to report visual clarity of the stimulus, feelings of “something being shown,” and feelings of “certainty” (Ramsøy and Overgaard 2004, 12). Other scales required observers only to report the visibility of the stimulus (Sergent and Dehaene 2004; Rausch and Zehetleitner 2016). Directly asking observers about their visual experience of specific stimuli seems to be the most suitable approach for the present study because it enables us to differentiate between visual experiences related to the target and those related to the display configuration. However, verbal reports about experience are often dismissed as scientific data because they lack a verifiable ground truth: there is no way one can establish the “true” conscious experience of the observer. The problems of missing ground truth can be circumvented by quantifying the degree to which verbal reports predict performance in the task. If participants report conscious experiences relevant for solving the experimental task, their reports should differentiate between correct and incorrect responses. Only one single previous study investigated the effect of repeated spatial configurations on observers’ verbal reports about their visual experience of the target elements. Schlagbauer , using masked displays and verbal reports after each single trial, observed that repeated spatial context was associated with as clearer visual experience of the target stimulus as well as higher confidence in target localization judgments. However, the study did not require observers to report their experience of the display configuration. Further, the correlation between verbal reports and localization performance was not analyzed.

Rationale of the present study

The present study addressed the issue of whether memory of spatial context acquired during visual search in repeated display configurations influences the subjective experience of the display configuration or the target stimulus. Further, we assessed the relationship between observers’ subjective reports about visual experience and their objective task performance. The experiment consisted of two parts: In the first part, participants had to localize a target letter “T” presented among distractor “L” letters. To induce variation in visibility, search displays were masked (see Fig. 1). Half of the displays were repeated displays: there were 12 different, but fixed target-distractor configurations presented in each block of the experiment. The other half were non-repeated displays, in which distractor locations were determined randomly at the beginning of each trial. Following observer’s localization response, one group of participants rated the perceptual clarity of the display configuration, and another group the perceptual clarity of the target. In a third “control” group, observers performed only the target localization task to examine if contextual cueing was affected by the concurrent assessment of participants’ search performance and verbal reports in each trial. In a second, consecutive part of the experiment, participants in all the three groups performed a short visual search task with unmasked displays. Participants were instructed to discriminate the orientation of the target letter “T” embedded in distractor “L” letters, the “standard” procedure in contextual cueing studies (for a review see, e.g. Goujon ). In this task, no reports were made about the clarity of the display configuration or the target item. Instead, only RTs were recorded. The discrimination task served as a secondary check for the effects of the concurrent assessment of observers’ verbal reports and search RTs on contextual cueing performance. The association between observers subjective reports and their search task performance was measured using Type 2 ROC analysis (Fleming ; Galvin ; see Supplementary Material).
Figure 1.

Sequence of events in the localization task (top panel) and discrimination task (bottom panel). In the localization task, participants were required to respond to the screen quadrant of the target stimulus as accurate as possible. The display was presented for an individually adjusted SOA (aiming at 75% correct performance), before it was masked by figure-8-shapes. After their localization response, participants in the configuration condition were asked to rate how clearly they saw the configuration and participants in the stimulus condition were asked to rate the clarity of the target stimulus. No questions were administered in the control condition. After the localization task, participants continued with a discrimination task, which was identical for the three rating conditions. In this task, the displays were visible until observers responded to the orientation of the target as fast and as accurate as possible. No masking occurred and no reports were collected in the discrimination task.

Sequence of events in the localization task (top panel) and discrimination task (bottom panel). In the localization task, participants were required to respond to the screen quadrant of the target stimulus as accurate as possible. The display was presented for an individually adjusted SOA (aiming at 75% correct performance), before it was masked by figure-8-shapes. After their localization response, participants in the configuration condition were asked to rate how clearly they saw the configuration and participants in the stimulus condition were asked to rate the clarity of the target stimulus. No questions were administered in the control condition. After the localization task, participants continued with a discrimination task, which was identical for the three rating conditions. In this task, the displays were visible until observers responded to the orientation of the target as fast and as accurate as possible. No masking occurred and no reports were collected in the discrimination task. If context memory was able to influence subjective visual experience, then the correlation between verbal reports and localization accuracy should increase over time for repeated over non-repeated displays in at least one of the two conditions, requiring observers either to report on the distractor configuration or the target stimulus. More specifically, if memory of search configurations affected subjective experience of the display configuration, then it might be expected that reports about the display configuration become more predictive of observers’ search performance in repeated displays. Alternatively, or in addition, context memory of the display configuration may affect subjective experience of the target item. Then, repeated displays should give rise to a stronger correlation between subjective reports of the target item and search performance in repeated displays. Bayes factors were used for statistical testing, as both the presence and the absence of the effects are of theoretical interest (Rouder ; Dienes 2011; Wetzels ).

Experiment

Methods

Participants

A total of 45 observers took part in the experiment (11 male; 1 left-handed, mean age: 25.7years). All participants reported normal or corrected-to-normal vision and provided written informed consent prior to the experiment. Participants received either €12 or course credit for their participation. The experiment was conducted according to the principles expressed in the Declaration of Helsinki (World Medical Association 2013).

Apparatus and stimuli

The experiment was conducted in a dimly lit room and run on a PC under the Windows XP operating system. The experiment was programed in MATLAB with the Psychtoolbox extension for stimulus presentation (Brainard 1997; Pelli 1997). Participants were seated in front of a 19″ CRT monitor [display resolution: 1024×768 pixels; refresh rate: 85Hz (AOC, Amsterdam, The Netherlands)] at a viewing distance of approximately 60cm. Search displays always consisted of one target T-shape among 11 distractor L-shapes. All 12 items in the search displays were dark gray (1.0cd/m2, 0.470.47 in size) and presented against a light gray background (25.4cd/m2). The items were scattered inside an area of 9.28 visual angle in a way that item density and display extension was as comparable as possible across search displays. Items were positioned at pseudo-randomly chosen locations on four (imaginary) concentric circles around the display center (radii: 2.32, 4.64, 6.96, and 9.28). The position of items was constrained by a minimum distance between two adjacent items of 2.32, at least one item on each circle and an equal number of items in each quadrant. These restrictions ensured that search displays were comparable in terms of item eccentricity and item density and that there was no guessing bias regarding the target quadrant. The “T”-shaped target stimulus was oriented randomly either 90 or 270 from the vertical midline and always appeared on the third circle from the display center but never on the horizontal or the vertical midline. There were 24 possible target locations on the third circle, of which 12 were used with repeating display configurations and 12 for the random configurations. The 11 “L”-shaped distractors were positioned at random locations on the four circles (with the restrictions above) and tilted either 0, 90, 180, or 270. In Part 1 of the experiment (localization task), the search displays were masked shortly after presentation by figure-8 shapes placed along eight concentric circles around the display center, covering the whole area of possible item locations.

Task and procedure

The sequence of events in each trial is illustrated in Fig. 1. Participants were randomly assigned to the configuration-, stimulus-, or control condition. The conditions differed only in the type of verbal reports. The procedure of the experiment, the behavioral tasks, and their order was the same across the three conditions (groups). In the initial localization task, each trial started with the presentation of a fixation cross in the center of the screen for 1500ms, followed by a blank interval of 200ms. Next, the search display was presented for an individually adjusted stimulus onset asynchrony (SOA; see Supplementary Material for the staircase procedure) until it was masked by the figure-8 shapes. Participants were asked to indicate in which quadrant of the screen the target was localized using the keys on the numeric key pad of a standard computer keyboard with their right hand (“1” for the lower left, “3” for the lower right, “7” for the upper left, and “9” for the upper right quadrant). Following participants’ localization response and a blank interval of 200ms, a question appeared on screen. In the configuration condition, participants were asked: “How clearly did you see the configuration”; in the stimulus condition participants were asked: “How clearly did you see the T?” The questions of both experimental conditions were presented together with a scale from 1 (“very unclear”) to 4 (“very clear”). Reports were given by participants pressing the corresponding key (“1”, “2”, “3”, or “4” key) on the keyboard using their left hand. After the verbal report, the next trial started with a blank interval of 200ms. No question was asked in the control condition, while the inter-trial interval was prolonged to 1000ms. No feedback was given. In the later discrimination task, trials started with a fixation cross for 500ms, followed by a blank interval of 200ms. When the search display appeared, observers were asked to respond to the orientation (to the left or the right) of the target stimulus as fast and as accurate as possible by pressing the left or right arrow key using the corresponding index finger. After a correct response, the next trial started after a blank interval of 500ms. An erroneous response resulted in the display of the word “Error” in the center of the screen for 1000ms. The localization task consisted of 480 trials, divided into 20 blocks of 24 trials each. In each block, 12 of the displays were repeated (repeated displays); the other 12 displays were generated randomly, with only the target position remaining constant across all trial blocks (non-repeated displays). The same repeated displays were used in the discrimination task, which consisted of 96 trials divided into 4 blocks of 24 trials each. Consequently, each repeated display was shown 20 times in Part 1 and 4 times in Part 2. Overall, the experiment took about 90min. The design of the experiment was a between-subject design, so that each participant only had to give ratings about the display configuration or the target stimulus (or no ratings at all). The between-subject design was chosen to ensure that verbal reports with different contents could not interfere with each other as well as holding task difficulty at a tolerable level. In the configuration condition, participants were asked to report the clarity of the configuration of the display after their localization response. They were instructed that configuration refers to the general outline of the search array, its form or shape and that they should report how well they perceived the display as a whole entity. In the stimulus condition, participants were asked to report the clarity of the target stimulus. They were instructed that this refers to the letter T only and that they should report how vividly they saw this item. In both conditions, participants were asked whether they understood the instruction, and this was also double checked at the end of the staircase procedure. The control condition was identical to the other two conditions except that no ratings were administered. The discrimination task was identical in all three conditions/groups.

Data analysis

The data from the localization task were collapsed into two epochs, with each epoch representing an average of 10 consecutive blocks, to obtain reasonably stable estimates of contextual cueing and the association between verbal reports and localization accuracy, the latter assessed by the area under Type 2 ROC curves (Fleming , see Supplementary Material for details). Type 2 ROC analysis quantifies the degree to which verbal reports predict trial accuracy independent of participants’ propensity to report high visual experience. Type 2 ROC curves control for rating criteria unlike gamma correlation coefficients (Masson and Rotello 2009) and logistic regression (Rausch and Zehetleitner 2017) and can be calculated even when there are more than two response options, unlike meta-d’ (Maniscalco and Lau 2012). Moreover, in Type 2 ROC analysis, no assumptions about the distributions of evidence in correct and incorrect trials has to be made (Fleming and Lau 2014).The data were analyzed using R (R Core Team 2014) Bayes Factors were calculated with the package “BayesFactor” (Morey and Rouder 2015). Localization accuracy, verbal reports, and the relationship between verbal reports and localization accuracy were analyzed with ANOVA-equivalent Bayes factors using Bayesian linear models with report condition as between-subject factor (three levels for accuracy: configuration, vs. stimulus vs. control; only two levels for verbal reports and the association between verbal reports and localization accuracy: configuration vs. stimulus), display type (two levels: repeated, non-repeated), and epoch (two levels: epoch 1 vs. epoch 2) as within-subject factors. The Bayes Factor of each main effect or interaction is obtained by comparing a linear model including the effect of interest to a model where the effect is omitted. This procedure allowed us to include covariates in the linear models (as implemented in the R package “BayesFactor” by Morey and Rouder 2015). As priors, we used previously suggested default variance priors for linear models with a scale parameter of (Rouder and Morey 2012). The evidence for or against an effect was considered as substantial if its Bayes Factor was larger than 3 or lower than 1/3 (Wetzels ). As posthoc tests, we computed the Bayesian equivalent of a one-sided paired t-test comparing the association between verbal reports and localization accuracy between repeated and non-repeated displays. We assumed a Cauchy distribution of the standardized effect sizes with the scale parameter r= over the interval 0 to ∞, which was suggested as a default prior in psychology (Morey and Rouder 2015). In the discrimination task, incorrect responses were discarded from the analysis (overall error rate: 3.3%). RTs were analyzed with Bayes factors calculated analogously to the analysis of the localization task performance with the factors report condition (configuration, stimulus, control; between-subject variable) and display type (repeated, non-repeated; within-subject variable).

Results

Localization task

Localization accuracy

Figure 2 shows that observers’ accuracy in the localization task increased over time (epochs). This improvement in performance was comparable across the three groups; however, it was larger for repeated over non-repeated displays, revealing a beneficial effect of learned spatial context on search performance. The Bayes factors for accuracy as dependent variable indicated main effects of display type [BF10=73.17] and epoch [BF10=38.04], but only anecdotal evidence for their two-way interaction [BF10=2.56]. A relatively early onset of the contextual cueing effect is not unexpected, given that the current localization task was split into only two epochs of 10 blocks each, while contextual cueing usually emerges already after approximately 4–6 repetitions/blocks (e.g. Chun and Jiang 1998). Importantly, there were no interactions of report condition and display type [BF10=0.19], as well as report condition, display type, and epoch [BF10=.17]. There was no conclusive evidence regarding the main effect of report condition [BF10=0.45], but substantial evidence for the interaction of report condition and epoch [BF10=4.91]. Direct tests showed that localization accuracy was comparable across report conditions in both the first and second epoch (see Supplementary Material for details).
Figure 2.

Mean localization performance as a function of epoch in the configuration, stimulus, and control condition (left, middle, and right panel, respectively).

Mean localization performance as a function of epoch in the configuration, stimulus, and control condition (left, middle, and right panel, respectively). In sum, we observed a general improvement in localization accuracy with training, which was higher in the configuration and control relative to the stimulus condition (see Fig. 2). Further, there was context-dependent learning, reflected by higher localization accuracy in repeated over non-repeated displays. Crucially, context-dependent learning was comparable across groups, suggesting that the acquisition of context memory was not selectively influenced by the concurrent assessment of verbal reports (see Fig. 2; exact descriptive statistics are provided in the Supplementary Material).

Verbal reports

An analogous 2 (report condition)×2 (display type)×2 (epoch) analysis with verbal reports as dependent variable revealed substantial main effects of display type [BF10=5.53] and epoch [BF10=216.03]. There was anecdotal evidence for a main effect of report condition [BF10=2.08], and an interaction between display type and epoch [BF10=1.28]. The analysis also revealed the absence of interactions between report condition and display type [BF10=0.11], as well as between report condition and epoch [BF10=0.13]. The three-way interaction was inconclusive, trending towards evidence for its absence [BF10=0.41]. These results suggest the operation of context-dependent and context-independent (i.e. procedural) learning in the present task and mirror those from the analysis of localization accuracy. The clarity of the display configuration and the target identity was greater in repeated relative to non-repeated displays. This is the effect of context-dependent learning. Further, clarity ratings increased in general through extended practice on the task (effect of context-independent learning), and there was a trend for clarity reports being higher when observers had to report on target identity compared to display configuration (see Fig. 3).
Figure 3.

Mean verbal reports in the localization task as a function of epoch in the configuration and stimulus condition (left and right panel, respectively).

Mean verbal reports in the localization task as a function of epoch in the configuration and stimulus condition (left and right panel, respectively).

Association between verbal reports and localization accuracy

Type 2 ROC analysis, used to measure the relation between verbal reports and localization accuracy, revealed a substantial three-way interaction of report condition, display type and epoch [BF10=15.14]. All main effects were inconclusive [report condition: BF10=1.55; display type: BF10=0.83; epoch: BF10=0.56]. The interactions of report condition and display type [BF10 =0.35] and of epoch and display type [BF10=0.40] were inconclusive, although leaning towards the null hypothesis. There was substantial evidence against an interaction of report condition and epoch [BF10=0.27]. As depicted in Fig. 4, the average area under ROC curves was greater in repeated compared to non-repeated displays, but only in the configuration condition. A posthoc analysis performed for the target condition revealed anecdotal evidence for a null effect of display type in epoch 1 [BF10=0.71] and substantial evidence for a null effect of display type in epoch 2 [BF10=0.27]. For the configuration condition, in contrast, there was substantial evidence for a null effect of display type in epoch 1 [BF10=0.27] and substantial evidence for an effect of display type in epoch 2 [BF10=3.70]. This suggests that repeated contexts are associated with a greater area under the ROC curve in the “late” epoch 2 in case of reports about the display configuration. But context memory did not exert an influence on the area under the ROC curve for reports about the target item in epoch 2.—Two control analyses investigated whether the effects of contextual cueing on the area under the ROC curve for reports about the display configuration were modulated by performance improvements in the localization task (for details, see Supplementary Material). In the first control analysis, localization accuracy and RTs were included as covariates in the analysis of Type 2 ROC curves. In the second control analysis, we examined only participants who displayed comparable accuracy scores in their localization performance in the three report conditions. Both control analyses confirmed the results pattern depicted in Fig. 4: the area under ROC curve for ratings of the display configuration increased over time. In contrast, no such effect was observed for ratings about the target item.
Figure 4.

Area under the Type 2 ROC curve quantifying the association between accuracy in the localization task and configuration reports (left panel) and target reports (right panel) as a function of epoch and context (repeated vs. non-repeated).

Area under the Type 2 ROC curve quantifying the association between accuracy in the localization task and configuration reports (left panel) and target reports (right panel) as a function of epoch and context (repeated vs. non-repeated).

Discrimination task

Reaction times

The analysis of RTs revealed a substantial main effect of display type [BF10=441.62], as well as evidence against the interaction between report condition and display type [BF10=0.09]. The main effect of report condition was inconclusive [BF10=0.73]. These results show that contextual learning acquired initially in a localization task is able to transfer to a subsequent discrimination task. Crucially for the present investigation, the transfer effects were comparable across the three report conditions (see Fig. 5). This would also mean that the processes of learning the repeated displays were equally efficient across the three report conditions.
Figure 5.

Mean RTs in the discrimination task as a function of display type (repeated vs. non-repeated) in the configuration, stimulus, and control condition (left, middle, and right panel, respectively).

Mean RTs in the discrimination task as a function of display type (repeated vs. non-repeated) in the configuration, stimulus, and control condition (left, middle, and right panel, respectively).

Discussion

The present experiment investigated the effect of learned spatial configurations on subjective visual experience of the display configuration and the target item in a visual search task. We observed that the learning of repeated target-distractor configurations was associated with an increase of visual experience of the display configurations as well as a greater association of subjective experience of the display configurations and localization accuracy. Concerning the visual experience of the target, context memory did not modulate the correlation between target ratings and localization performance, though learned contexts were associated with greater visual experience of the target item. The most parsimonious explanation for the present pattern of results is that memory of visual context enhances the representation of the current display configuration. This improved representation then guides visual attention to the target of visual search, thus speeding up visual search. Previous studies suggested that guidance of attention is one of the mechanisms underlying visual search benefits of repeated displays (Chun and Jiang 1998; Johnson ; Geyer ). At the same time, the improved representation might form the basis for reports about the subjective visual experience of the display configuration. Learning of the display configuration will also increase the correlation between verbal reports and localization accuracy: Assuming that the quality of the representation of the current display configuration varies from trial to trial, then, whenever there is a strong representation, there will be both a vivid experience of the display configuration and a high probability of correct target localization. Whenever the representation of the display is rather poor, there is neither a clear experience of display configuration nor a high chance of detecting (localizing) the target item. When displays are non-repeated, the quality of the representation of the configuration varies as well, but representation of the configuration is no longer predictive of the location of the target stimulus and thus the quality of the representation is less predictive of accurate target localization. At a consequence, the associations between subjective reports about the experience of the configuration and localization accuracy is reduced. The idea that repeated displays enhance the representation of the configuration, which then guides attention to the target, can also provide an explanation why repeated displays increase the visual experience of the target, but leave the correlation with localization accuracy unchanged: When attention is allocated to the target more efficiently, there will also be more time and resources to process the target, eventually giving rise to a more vivid experience of the target item. However, repeated displays seem not to have changed the experience of the target over and above the effect caused by improved localization of the target: If this were the case, repeated displays should have increased subjective experience of the target specifically in correct trials but not in incorrect trials, thus increasing the correlation between subjective experience of the target and localization performance. Instead, repeated displays increased subjective experience of the target item indiscriminately for both correct and incorrect search trials, rather than for correct trials alone. Consequently, it is likely that the effect of repeated displays on experience of the target are only a by-product of the facilitation of visual search by repeated search contexts instead of enhancing conscious processing of the target item. This observation relates to previous investigations of context memory, showing that repeated displays do not only guide attention, but may also speed up processes after attention has already been allocated at the target, including perceptual analysis of the target (Töllner ) and response selection (Kunar ; Hout and Goldinger 2012). One possibility is that context memory indeed speeds up processing of the target, but the effect does not affect conscious experience of the target item. A second possibility is that specific features of the present task diminished the influence of learned displays on post-selective processes: Because observers were asked to localize, not identify the target, it is possible that observers only processed the target to a minimal extent. In summary, we interpret the present findings from a localization task as evidence for the beneficial effects of context memory on conscious experience of the display configuration. We find no evidence for the effects of context memory on subjective experience of the target stimulus.

Is metacognition influenced by learned context?

Verbal reports about subjective experience always rely on some degree of metacognition: participants need to know about conscious experience in order to report it (Dienes 2004; Seth 2008; Zehetleitner and Rausch 2013). Specifically, verbal reports about visual experience of the display configuration seem to require metacognition about perceptual processing of the display configuration. Consequently, the present results may point out an effect of contextual memory on metacognition and not only on conscious experience. In line with this interpretation, context was observed to increase the correlation between subjective reports experience of the display configuration and localization accuracy. The correlation between subjective reports and objective performance is often considered one important aspect of metacognition (Fleming and Lau 2014). Noteworthy, metacognitive access to visual context is consistent with a recent eye-tracking study (Kaunitz ). In their study, Kaunitz et al. asked their observers to search for face targets that were embedded in a crowded natural scene (of other persons/faces). Following search, they were asked about their incidental memory for visually inspected distractor faces and the confidence about their decisions. Interestingly, memory accuracy was correlated with confidence ratings, suggesting that the memory of distractor faces was consciously accessible. The results of the present study may add to their findings in at least two aspects: First, while Kaunitz et al. used faces as stimuli, the present results may indicate metacognition for relatively untrained and seemingly meaningless laboratory stimuli of letter arrangements. Second, according to the present study, metacognition may be influenced by more permanent (durable) visual memory instead of only the memory related to the immediate search trial (as in Kaunitz ). We do of course acknowledge that the present study does not involve conventional measures of metacognition. The standard approach is to ask participants about their confidence of being correct in the experimental task, here: target localization accuracy, instead of asking them about the clarity of the distractor configuration vs. the target stimulus (Nelson and Narens 1990; Kepecs and Mainen 2012; Fleming and Lau 2014). Confidence judgments are not always equivalent to subjective reports about visual experience (Sandberg ; Zehetleitner and Rausch 2013; Wierzchoń ; Jachs ; Rausch ). For example, subjective reports about visual experience may underestimate metacognition if participants have knowledge about their performance that is not experienced visually, for example, an intuition of being correct in the task (Rausch and Zehetleitner 2016). Notably, the assessment of metacognition may come to different results when experimental procedures designed to minimize the impact of bias are used: By asking observers which of two preceding task decisions they are willing to bet on, metacognition in masked orientation judgments was shown to be even Bayes-optimal (Peters and Lau 2015). At a consequence, future studies should investigate the relation between contextual memory and metacognition using more direct measures of metacognition.

Implication for the neurocognitive mechanisms of contextual cueing

The present results are well in line with neuroscientific investigations suggesting that contextual cueing of visual search is supported by the medial temporal lobe (MTL) and specifically the hippocampus (HC, Chun and Phelps 1999; Geyer ; Greene ). The traditional view is that these structures are essential for declarative memory, which typically includes awareness of learned materials (Manns and Squire 2001). If contextual cueing is based on MTL/HC structures, and if these structures are accessible to consciousness, the question arises why contextual cueing is not associated with awareness. A previously suggested solution to this controversy is that MTL and HC are not exclusively dedicated to explicit memory, but serve other forms of relational memory, which can be implicit, too (Chun and Phelps 1999; Henke 2010). This idea is consistent with a recent functional magnetic resonance imaging study (Geyer ), suggesting that individual repeated search displays that yield above-chance knowledge in an explicit recognition test (performed concurrently with the search task) are associated with increased MTL/HC activations relative to non-repeated displays. Interestingly, these areas also showed decreased activations in the absence of awareness for other individual repeated displays. Thus, the very same (MTL/HC) areas would process explicit and implicit search displays, though these areas would exert their effects in functionally different ways (repetition enhancement vs. suppression, respectively). The present findings may point out another possibility, namely that MTL/HC activity during contextual cuing is associated with consciousness, although not with awareness of learning, but with a changed subjective experience of search arrays. Under this account, MTL/HC activations during contextual cuing would no longer be special in the sense that they do not give rise to conscious experience. However, neuroscientific studies are required to put this proposal into test.

Conclusions

The present study suggests that the effects of spatial memory acquired during repeated encounters of identical search arrays go beyond the effects on visual search behavior and modulate, that is, enhance the subjective experience of the display configuration.

Supplementary data

Supplementary data is available at NCONSC Journal online. Click here for additional data file.
  53 in total

1.  A history of introspection.

Authors:  E G BORING
Journal:  Psychol Bull       Date:  1953-05       Impact factor: 17.737

2.  Implicit memory influences the allocation of attention in visual cortex.

Authors:  Jeffrey S Johnson; Geoffrey F Woodman; Elsie Braun; Steven J Luck
Journal:  Psychon Bull Rev       Date:  2007-10

3.  Post-decision wagering measures metacognitive content, not sensory consciousness.

Authors:  Anil K Seth
Journal:  Conscious Cogn       Date:  2007-06-27

4.  Spatial constraints on learning in visual search: modeling contextual cuing.

Authors:  Timothy F Brady; Marvin M Chun
Journal:  J Exp Psychol Hum Percept Perform       Date:  2007-08       Impact factor: 3.332

5.  Sources of bias in the Goodman-Kruskal gamma coefficient measure of association: implications for studies of metacognitive processes.

Authors:  Michael E J Masson; Caren M Rotello
Journal:  J Exp Psychol Learn Mem Cogn       Date:  2009-03       Impact factor: 3.051

6.  Incidental learning speeds visual search by lowering response thresholds, not by improving efficiency: evidence from eye movements.

Authors:  Michael C Hout; Stephen D Goldinger
Journal:  J Exp Psychol Hum Percept Perform       Date:  2011-05-16       Impact factor: 3.332

7.  The Psychophysics Toolbox.

Authors:  D H Brainard
Journal:  Spat Vis       Date:  1997

8.  Large Capacity of Conscious Access for Incidental Memories in Natural Scenes.

Authors:  Lisandro N Kaunitz; Elise G Rowe; Naotsugu Tsuchiya
Journal:  Psychol Sci       Date:  2016-08-09

9.  Contextual cuing as a form of nonconscious learning: Theoretical and empirical analysis in large and very large samples.

Authors:  Ben Colagiuri; E J Livesey
Journal:  Psychon Bull Rev       Date:  2016-12

10.  Measuring consciousness: is one measure better than the other?

Authors:  Kristian Sandberg; Bert Timmermans; Morten Overgaard; Axel Cleeremans
Journal:  Conscious Cogn       Date:  2010-02-04
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.