The effects of emotional arousal on pupil size depend on luminance
Scientific Reports (2024)
Jasmine Pan, Xuelin Sun, Edison Park, Marine Kaufmann, Michaela Klimova, Joseph T. McGuire & Sam Ling
Pupillometry is widely used to measure arousal states. The primary functional role of the pupil, however, is to respond to the luminance of visual inputs. We previously demonstrated that cognitive effort-related arousal interacted multiplicatively with luminance, with the strongest pupillary effects of arousal occurring at low-to-mid luminances (< 37 cd/m2), implying a narrow range of conditions ideal for assessing cognitive arousal-driven pupillary differences. Does this generalize to other forms of arousal? To answer this, we assessed luminance-driven pupillary response functions while manipulating emotional arousal, using well-established visual and auditory stimulus sets. At the group level, emotional arousal interacted with the pupillary light response differently from cognitive arousal: the effects occurred primarily at much lower luminances (< 20 cd/m2). Analyses at the individual- participant level revealed qualitatively distinct patterns of modulation, with a sizable number of individuals displaying no arousal response to the visual or auditory stimuli, regardless of luminance. Together, our results suggest that effects of arousal on pupil size are not monolithic: different forms of arousal exert different patterns of effects. More practically, our findings suggest that lower luminances create better conditions for measuring pupil-linked arousal, and when selecting ambient luminance levels, consideration of the arousal manipulation and individual differences is critical.
Differential cortical and subcortical visual processing with eyes shut
Journal of Neurophysiology (2024)
Nicholas Cicero, Michaela Klimova, Laura Lewis & Sam Ling
Closing our eyes largely shuts down our ability to see. That said, our eyelids still pass some light, allowing our visual system to coarsely process information about visual scenes, such as changes in luminance. However, the specific impact of eye closure on processing within the early visual system remains largely unknown. To understand how visual processing is modulated when eyes are shut, we used functional magnetic resonance imaging (fMRI) to measure responses to a flickering visual stimulus at high (100%) and low (10%) temporal contrasts, while participants viewed the stimuli with their eyes open or closed. Interestingly, we discovered that eye closure produced a qualitatively distinct pattern of effects across the visual thalamus and visual cortex. We found that with eyes open, low temporal contrast stimuli produced smaller responses, across the lateral geniculate nucleus (LGN), primary (V1) and extrastriate visual cortex (V2). However, with eyes closed, we discovered that the LGN and V1 maintained similar BOLD responses as the eyes open condition, despite the suppressed visual input through the eyelid. In contrast, V2 and V3 had strongly attenuated BOLD response when eyes were closed, regardless of temporal contrast. Our findings reveal a qualitatively distinct pattern of visual processing when the eyes are closed - one that is not simply an overall attenuation, but rather reflects distinct responses across visual thalamocortical networks, wherein the earliest stages of processing preserves information about stimuli but is then gated off downstream in visual cortex.
Attention preserves the selectivity of feature-tuned normalization
Journal of Neurophysiology (2023)
Michaela Klimova, Ilona Bloem & Sam Ling
Attention and divisive normalization both contribute to making visual processing more efficient. Attention selectively increases the neural gain of relevant information in the early visual cortex, resulting in stronger perceived salience for attended regions or features. Divisive normalization improves processing efficiency by suppressing responses to homogeneous inputs and highlighting salient boundaries, facilitating sparse coding of inputs. Theoretical and empirical research suggest a tight link between attention and normalization, wherein attending to a stimulus results in a release from normalization, thereby allowing for an increase in neural response gain. In the present study, we address whether attention alters the qualitative properties of normalization. Specifically, we examine how attention influences the feature-tuned nature of normalization, whereby suppression is stronger between visual stimuli whose orientation contents are similar, and weaker when the orientations are different. Ten human observers viewed stimuli that varied in orientation content while we acquired fMRI BOLD responses under two attentional states: attending toward or attending away from the stimulus. Our results indicate that attention does not alter the specificity of feature-tuned normalization. Instead, attention seems to enhance visuocortical responses evenly, regardless of the degree of orientation similarity within the stimulus. Since visuocortical responses exhibit adaptation to statistical regularities in natural scenes, we conclude that while attention can selectively increase the gain of responses to attended items, it does not appear to alter the ecologically relevant correspondence between orientation differences and strength of tuned normalization.
Feature-based attention multiplicatively scales the fMRI-BOLD contrast-response function
Journal of Neuroscience (2022)
Joshua Foster & Sam Ling
Functional MRI (fMRI) plays a key role in the study of attention. However, there remains a puzzling discrepancy between attention effects measured with fMRI and with electrophysiological methods. While electrophysiological studies find that attention increases sensory gain, amplifying stimulus-evoked neural responses by multiplicatively scaling the contrast-response function (CRF), fMRI appears to be insensitive to these multiplicative effects. Instead, fMRI studies typically find that attention produces an additive baseline shift in the blood-oxygen-level-dependent (BOLD) signal. These findings suggest that attentional effects measured with fMRI reflect top-down inputs to visual cortex, rather than the modulation of sensory gain. If true, this drastically limits what fMRI can tell us about how attention improves sensory coding. Here, we examined whether fMRI is sensitive to multiplicative effects of attention using a feature-based attention paradigm designed to preclude any possible additive effects. We measured BOLD activity evoked by a probe stimulus in one visual hemifield while participants (6 male, 6 female) attended to the probe orientation (attended condition), or to an orthogonal orientation (unattended condition), in the other hemifield. To measure CRFs in visual areas V1-V3, we parametrically varied the contrast of the probe stimulus. In all three areas, feature-based attention increased contrast gain, improving sensitivity by shifting CRFs towards lower contrasts. In V2 and V3, we also found an increase in response gain, an increase in the responsivity of the CRF, that was greatest at inner eccentricities. These results provide clear evidence that the fMRI-BOLD signal is sensitive to multiplicative effects of attention.
Congrats to Luis, recipient of the 2021 NIH D-SPAN Scholar Award!!
Luis Ramirez: 2021 D-SPAN Scholar
F99 Phase: Boston University | Sponsor: Sam Ling
Very exciting news! The NIH Blueprint Diversity Specialized Predoctoral to Postdoctoral Advancement in Neuroscience (D-SPAN) Award supports the pre- to post-doctoral transition of diverse graduate students. This two-phase award will facilitate completion of the doctoral dissertation and transition of talented graduate students (F99 phase) to strong neuroscience research postdoctoral positions (K00 phase), and will provide career development opportunities relevant to their long-term career goal of becoming independent neuroscience researchers. Currently, Luis is a PhD Candidate in the Graduate Program for Neuroscience at Boston University (BU), working with Dr. Sam Ling. His dissertation combines non-invasive human brain imaging, computational modeling, and psychophysics to understand the neurocomputational mechanisms that underly how attention regulates perception. In the long-term, Luis aims to investigate how perception and memory interact in visual cortex, and how attention facilitates this interaction. Moreover, as a first-gen, Afro-Latino student, Luis is committed to improving academia for historically excluded students, having led critical DEI committees and graduate student organizations throughout BU.
Arousal-based pupil modulation is dictated by luminance
Scientific Reports (2022)
Jasmine Pan, Michaela Klimova, Joseph McGuire & Sam Ling
Pupilometry has become a standard measure for assessing arousal state. However, environmental factors such as luminance, a primary dictator of pupillary responses, often vary across studies. To what degree does luminance interact with arousal-driven pupillary changes? Here, we parametrically assessed luminance-driven pupillary responses across a wide-range of luminances, while concurrently manipulating cognitive arousal using auditory math problems of varying difficulty. At the group-level, our results revealed that the modulatory effect of cognitive arousal on pupil size interacts multiplicatively with luminance, with the largest effects occurring at low and mid-luminances. However, at the level of individuals, there were qualitatively distinct individual differences in the modulatory effect of cognitive arousal on luminance-driven pupillary responses. Our findings suggest that pupillometry as a measure for assessing arousal requires more careful consideration: there are ranges of luminance levels that are more ideal in observing pupillary differences between arousal conditions than others.
Saturating nonlinearities of contrast response in human visual cortex
Journal of Neuroscience (2022)
Louis Vinke, Ilona Bloem & Sam Ling
Response nonlinearities are ubiquitous throughout the brain, especially within sensory cortices where changes in stimulus intensity typically produce compressed responses. Although this relationship is well established in electrophysiological measure- ments, it remains controversial whether the same nonlinearities hold for population-based measurements obtained with human fMRI. We propose that these purported disparities are not contingent on measurement type and are instead largely dependent on the visual system state at the time of interrogation. We show that deploying a contrast adaptation paradigm permits reliable measurements of saturating sigmoidal contrast response functions (10 participants, 7 female). When not controlling the adaptation state, our results coincide with previous fMRI studies, yielding nonsaturating, largely linear contrast responses. These findings highlight the important role of adaptation in manifesting measurable nonlinear responses within human visual cortex, reconciling discrepancies reported in vision neuroscience, re-establishing the qualitative relationship between stimulus intensity and response across different neural measures and the concerted study of cortical gain control
The specificity of orientation-tuned normalization within human early visual cortex
Journal of Neurophysiology (2021)
Michaela Klimova, Ilona Bloem & Sam Ling
Normalization within visual cortex is modulated by contextual influences; stimuli sharing similar features suppress each other more than dissimilar stimuli. This feature-tuned component of suppression depends on multiple factors, including the orientation content of stimuli. Indeed, pairs of stimuli arranged in a center-surround configuration attenuate each other’s response to a greater degree when oriented collinearly than when oriented orthogonally. Although numerous studies have examined the nature of surround suppression at these two extremes, far less is known about how the strength of tuned normalization varies as a function of continuous changes in orientation similarity, particularly in humans. In this study, we used functional magnetic resonance imaging (fMRI) to examine the bandwidth of orientation-tuned suppression within human visual cortex. Blood-oxygen- level-dependent (BOLD) responses were acquired as participants viewed a full-field circular stimulus composed of wedges of ori- entation-bandpass filtered noise. This stimulus configuration allowed us to parametrically vary orientation differences between neighboring wedges in gradual steps between collinear and orthogonal. We found the greatest suppression for collinearly arranged stimuli with a gradual increase in BOLD response as the orientation content became more dissimilar. We quantified the tuning width of orientation-tuned suppression, finding that the voxel-wise bandwidth of orientation tuned normalization was between 20 and 30, and did not differ substantially between early visual areas. Voxel-wise analyses revealed that suppression width covaried with retinotopic preference, with the tightest bandwidths at outer eccentricities. Having an estimate of orienta- tion-tuned suppression bandwidth can serve to constrain models of tuned normalization, establishing the precise degree to which suppression strength depends on similarity between visual stimulus components.
Temporal attention selectively enhances target features
Journal of Vision (2021)
Luis Ramirez, Joshua Foster & Sam Ling
Temporal attention, the allocation of attention to a moment in time, improves perception. Here, we examined the computational mechanism by which temporal attention improves perception, under a divisive normalization framework. Under this framework, attention can improve perception of a target signal in three ways: stimulus enhancement (increasing gain across all sensory channels), signal enhancement (selectively increasing gain in channels that encode the target stimulus), or external noise exclusion (reducing the gain in channels that encode irrelevant features). These mechanisms make diverging predictions when a target is embedded in varying levels of noise: stimulus enhancement improves performance only when noise is low, signal enhancement improves performance at all noise intensities, and external noise exclusion improves performance only when noise is high. To date, temporal attention studies have used noise-free displays. Therefore, it is unclear whether temporal attention acts via stimulus enhancement (amplifying both target features and noise) or signal enhancement (selectively amplifying target features) because both mechanisms predict improved performance in the absence of noise. To tease these mechanisms apart, we manipulated temporal attention using an auditory cue while parametrically varying external noise in a fine-orientation discrimination task. Temporal attention improved perceptual thresholds across all noise levels. Formal model comparisons revealed that this cuing effect was best accounted for by a combination of signal enhancement and stimulus enhancement, suggesting that temporal attention improves perceptual
Population spatial frequency tuning in human early visual cortex
Journal of Neurophysiology (2020)
Sara Aghajari, Louis Vinke & Sam Ling
Neurons within early visual cortex are selective for basic image statistics, including spatial frequency. However, these neurons are thought to act as band-pass filters, with the window of spatial frequency sensitivity varying across the visual field and across visual areas. Although a handful of previous functional MRI studies have examined human spatial frequency sensitivity using conventional designs and analysis methods, these measurements are time consuming and fail to capture the precision of spatial frequency tuning (bandwidth). In this study, we introduce a model-driven approach to fMRI analyses that allows for fast and efficient estimation of popu- lation spatial frequency tuning (pSFT) for individual voxels. Blood oxygen level-dependent (BOLD) responses within early visual cortex were acquired while subjects viewed a series of full-field stimuli that swept through a large range of spatial frequency content. Each stimulus was generated by band-pass filtering white noise with a central frequency that changed periodically between a minimum of 0.5 cycles/degree (cpd) and a maximum of 12 cpd. To estimate the underlying frequency tuning of each voxel, we assumed a log- Gaussian pSFT and optimized the parameters of this function by comparing our model output against the measured BOLD time series. Consistent with previous studies, our results show that an increase in eccentricity within each visual area is accompanied by a drop in the peak spatial frequency of the pSFT. Moreover, we found that pSFT bandwidth depends on eccentricity and is correlated with the pSFT peak; populations with lower peaks possess broader bandwidths in logarithmic scale, whereas in linear scale this relationship is reversed.
Luminance potentiates human visuocortical responses
Journal of Neurophysiology (2020)
Louis Vinke & Sam Ling
Our visual system is tasked with transforming variations in light within our environment into a coherent percept, typically described using properties such as luminance and contrast. Models of vision often downplay the impor- tance of luminance in shaping cortical responses, instead prioritizing representations that do not covary with overall luminance (i.e., con- trast), and yet visuocortical response properties that may reflect luminance encoding remain poorly understood. In this study, we examined whether well-established visuocortical response properties may also reflect luminance encoding, challenging the idea that lumi- nance information itself plays no significant role in supporting visual perception. To do so, we measured functional activity in human visual cortex when presenting stimuli varying in contrast and mean lumi- nance, and found that luminance response functions are strongly contrast dependent between 50 and 250 cd/m2, confirmed with a subsequent experiment. High-contrast stimuli produced linearly in- creasing responses as luminance increased logarithmically for all early visual areas, whereas low-contrast stimuli produced either flat (V1) or assorted positive linear (V2 and V3) response profiles. These results reveal that the mean luminance information of a visual signal persists within visuocortical representations, potentially reflecting an inherent imbalance of excitatory and inhibitory components that can be either contrast dependent (V1 and V2) or contrast invariant (V3). The role of luminance should be considered when the aim is to drive potent visually evoked responses and when activity is compared across studies. More broadly, overall luminance should be weighed heavily as a core feature of the visual system and should play a significant role in cortical models of vision.
Normalization governs attentional modulation within human visual cortex
Nature Communications (2019)
Ilona Bloem & Sam Ling
Although attention is known to increase the gain of visuocortical responses, its underlying neural computations remain unclear. Here, we use fMRI to test the hypothesis that a neural population’s ability to be modulated by attention is dependent on divisive normalization. To do so, we leverage the feature-tuned properties of normalization and find that visuocortical responses to stimuli sharing features normalize each other more strongly. Comparing these normalization measures to measures of attentional modulation, we demonstrate that sub- populations which exhibit stronger normalization also exhibit larger attentional benefits. In a converging experiment, we reveal that attentional benefits are greatest when a subpopulation is forced into a state of stronger normalization. Taken together, these results suggest that the degree to which a subpopulation exhibits normalization plays a role in dictating its potential for attentional benefits.
Dichoptic vision in the absence of attention: neither fusion nor rivalry
Scientific Reports (2019)
Cheng Stella Qian, Sam Ling & Jan W. Brascamp
When the two eyes’ processing streams meet in visual cortex, two things can happen: sufficiently similar monocular inputs are combined into a fused representation, whereas markedly different inputs engage in rivalry. interestingly, the emergence of rivalry appears to require attention. Withdrawing attention causes the alternating monocular dominance that characterizes rivalry to cease, apparently allowing both monocular signals to be processed simultaneously. What happens to these signals in this case, however, remains something of a mystery; are they fused into an integrated representation? In a set of experiments, we show this not to be the case: visual aftereffects are consistent with the simultaneous yet separate presence of two segregated monocular representations, rather than a joint representation. these results provide evidence that dichoptic vision without attention prompts a third and previously unknown mode, where both eyes’ inputs receive equal processing, but escape interocular fusion.
Visuocortical changes during a freezing-like state in humans
Neuroimage (2018)
Maria Lojowska, Sam Ling, Karin Roelofs, Erno Hermans
An adaptive response to threat requires optimized detection of critical sensory cues. This optimization is thought to be aided by freezing - an evolutionarily preserved defensive state of immobility characterized by parasympathetically mediated fear bradycardia and regulated by the amygdala-periaqueductal grey (PAG) circuit. Behavioral observations in humans and animals have suggested that freezing is also a state of enhanced visual sensitivity, particularly for coarse visual information, but the underlying neural mechanisms remain unclear. We induced a freezing-like state in healthy volunteers using threat of electrical shock and measured threat-related changes in both stimulus-independent (baseline) and stimulus-evoked visuocortical activity to low- vs. high-spatial frequency gratings, using functional MRI. As measuring immobility is not feasible in MRI environments, we used fear bradycardia and amygdala- PAG coupling in inferring a freezing-like state. An independent functional localizer and retinotopic mapping were used to assess the retinotopic specificity of visuocortical modulations. We found a threat- induced increase in baseline (stimulus-independent) visuocortical activity that was retinotopically nonspecific, which was accompanied by increased connectivity with the amygdala. A positive correlation between visuocortical activity and fear bradycardia (while controlling for sympathetic activation), and a concomitant increase in amygdala-PAG connectivity, suggest the specificity of these findings for the parasympathetically dominated freezing-like state. Visuocortical responses to gratings were retinotopically specific but did not differ between threat and safe conditions across participants. However, individuals who exhibited better discrimination of low-spatial frequency stimuli showed reduced stimulus-evoked V1 responses under threat. Our findings suggest that a defensive state of freezing involves an integration of preparatory defensive and perceptual changes that is regulated by a common mechanism involving the amygdala.
Visual memories bypass normalization
Psychological Science (2018)
How distinct are visual memory representations from visual perception? Although evidence suggests that briefly remembered stimuli are represented within early visual cortices, the degree to which these memory traces resemble true visual representations remains something of a mystery. Here, we tested whether both visual memory and perception succumb to a seemingly ubiquitous neural computation: normalization. Participants were asked to remember the contrast of visual stimuli, which were pit against each other to promote normalization either in perception or in visual memory. Our results revealed robust normalization between visual representations in perception, yet no signature of normalization occurring between working memory stores – neither between representations in memory, nor between memory representations and visual inputs. These results provide unique insight into the nature of visual memory representations, illustrating that visual memory representations follow a different set of computational rules, bypassing normalization, a canonical visual computation.