Role of Visual Cortical Plasticity in the Development and Treatment of Amblyopia and other Neurodevelopmental DisordersView this Special Issue
Review Article | Open Access
Joana Carvalho, Remco J. Renken, Frans W. Cornelissen, "Studying Cortical Plasticity in Ophthalmic and Neurological Disorders: From Stimulus-Driven to Cortical Circuitry Modeling Approaches", Neural Plasticity, vol. 2019, Article ID 2724101, 12 pages, 2019. https://doi.org/10.1155/2019/2724101
Studying Cortical Plasticity in Ophthalmic and Neurological Disorders: From Stimulus-Driven to Cortical Circuitry Modeling Approaches
Unsolved questions in computational visual neuroscience research are whether and how neurons and their connecting cortical networks can adapt when normal vision is compromised by a neurodevelopmental disorder or damage to the visual system. This question on neuroplasticity is particularly relevant in the context of rehabilitation therapies that attempt to overcome limitations or damage, through either perceptual training or retinal and cortical implants. Studies on cortical neuroplasticity have generally made the assumption that neuronal population properties and the resulting visual field maps are stable in healthy observers. Consequently, differences in the estimates of these properties between patients and healthy observers have been taken as a straightforward indication for neuroplasticity. However, recent studies imply that the modeled neuronal properties and the cortical visual maps vary substantially within healthy participants, e.g., in response to specific stimuli or under the influence of cognitive factors such as attention. Although notable advances have been made to improve the reliability of stimulus-driven approaches, the reliance on the visual input remains a challenge for the interpretability of the obtained results. Therefore, we argue that there is an important role in the study of cortical neuroplasticity for approaches that assess intracortical signal processing and circuitry models that can link visual cortex anatomy, function, and dynamics.
Unravelling the organization of the visual cortex is fundamental for understanding the foundations of vision in health and disease. A prominent feature of this organization is the presence of a multitude of visual field maps. These maps are spatially and hierarchically organized representations of the retinal image and are often specialized to encode specific environmental visual attributes. Studying these cortical visual maps is relevant as it enables the characterization of the structure and function of the visual cortex and therefore the study of the neuroplastic capacity of the brain. With the latter, we refer to the ability of the brain to adapt its function and structure in response to either injury or to a treatment designed to recover visual function.
Over the last two decades, visual field mapping has been extensively used to infer neuronal reorganization resulting from visual field defects or neuroophthalmologic diseases. For a review, see Wandell and Smirnakis . Because of its focus on the analysis of individual participants and the relative amount of detail provided, the pRF model seems ideal to study questions on neuroplasticity—at least in theory. Some of the hypotheses that can be tested with pRF mapping are as follows: are the neurons within the lesion projection zone active? Is there a displacement in position or enlargement of the pRF size during development, following a retinal or cortical lesion? Do the pRF properties change in response to monocular treatments that promote the use of the amblyopic eye, e.g., patching or blurring therapy?
Given that visual neuroplasticity is greatest during early stages of development (childhood), the characterization of the pRF properties has special relevance to determine, in vivo, the presence of atypical properties of the visual cortex during development and plasticity. In particular, changes in pRF size have been reported in a series of studies on developmental disorders. Clavagnier and colleagues measured enlarged pRF sizes in primary visual areas (V1-V3) in the cortical projection from the amblyopic eye as compared to the fellow eye . Schwarzkopf and colleagues reported that individuals with autism spectrum disorder (ASD) have larger pRFs as compared to controls . Anderson and colleagues found smaller pRF sizes in the early visual cortex of individuals with schizophrenia compared to controls, using a specific pRF model that takes into account the center surround structure of the RF .
In the case of congenital visual pathway abnormalities that affect the optic nerve crossing at the chiasm, e.g., achiasma, albinism, and hemi-hydranencephaly, several studies revealed overlapping visual fields and bilateral vertical symmetric pRF representations [8–12]. This contrasts with the case of a single patient that had her left hemisphere removed at the age of three, who did show the expected right hemifield blindness, even though she had larger representations of the central visual field in extrastriate visual maps, which was particularly apparent in area LO1 in the right hemisphere .
Hence, the pRF modeling approach has been applied with at least some degree of success to reveal neuroplastic changes at the level of the visual cortex. Nevertheless, in the present paper, we will briefly indicate issues with the current pRF approach as it relates to neuroplasticity and ways to improve the methods. Finally, we will argue that we should also look beyond it to fully address questions on neuroplasticity.
2. Limitations of Current Stimulus-Driven Approaches When Studying Neuroplasticity
We address the question to what extent population receptive field mapping is actually a suitable tool to capture cortical plasticity. We point out various limitations. The most important one is that the assumption of the receptive field and map stability in healthy controls is largely untenable.
The most common and straightforward manner in which the pRF approach has been applied is to compare model parameters between either two groups of participants—usually a patient group and matched controls [8, 14], or between the affected eye and the normal fellow eye, which can be done in the case of monocular developmental conditions such as amblyopia . In both types of studies, it is commonly assumed that the differences in pRF estimates are caused by differences in brain organization and eye-brain connectivity of the two groups or the two eyes. However, there are various issues that complicate the interpretation of pRF differences in health and disease. A number of these limitations were recently discussed by Dumoulin and Knapen , and for this reason, we will only reiterate the most critical ones.
2.1. Changes at the Level of the Eye Limit the Use of pRF Mapping to Study Neuroplasticity in Both Ophthalmic and Neurological Diseases
Estimates of pRFs are based on the stimulus input. In numerous ophthalmic diseases, changes at the level of the eye—such as cataract or retinal lesions—strongly modify the visual input. This could be a decrease in visual acuity, contrast sensitivity, or the entire loss of vision in part of the visual field. Consequently, in many of such diseases, the stimulus-driven input to the brain will be different and usually deteriorated. In neurological conditions such as in hemianopia, retrograde degeneration of the retina [16, 17] gives rise to a similar concern. As changes in the visual input have a direct effect on the signal amplitude, straightforward differences in BOLD signal cannot be taken as an indicator of neuroplasticity or degeneration at the level of the cortex.
The retinotopic maps of healthy adults with normal or corrected to normal vision are stable over time when measured under similar environmental and cognitive factors [18, 19]. Hence, it would appear that changes in maps or population properties should be a good indication for the presence of neuroplasticity. Indeed, it was found that in patients with long-term visual impairment due to macular degeneration, the pRF of voxels representing both the scotomatic area and neighboring regions are displaced and changed in size .
However, there is mounting evidence that simple stimulus manipulations, e.g., masks mimicking retinal lesions, can have a large effect on the population-receptive field estimates in healthy participants. Estimated pRF properties (position shift and scaled size), similar to those in patients with retinal lesions, were observed in healthy adults in whom a visual field defect was simulated [20–22]. Comparable shifts in pRF position and scaling of pRF size were also found in an experiment that used scotopic illumination levels to examine the “rod scotoma” in the central visual field . In other words, changes in visual input can mimic the consequences of lesions due to ophthalmic disease in healthy observers. This implies that observed differences in pRF properties in patients relative to controls may simply reflect normal responses to a lack in visual input rather than a reorganization of the visual cortex. Therefore, just by themselves, changes in pRF measures are insufficient to decide on the presence of neuroplasticity.
The feasibility to use pRF estimates to topographically map visual field defects in the cortex, particularly in early-stage disease, is further complicated by two aspects. First, neurons near the border of either the scotoma or the edge of the visual stimulus field may be partially stimulated. In such cases, the stimulus aperture partially activates receptive fields that belong to voxels whose pRF center would ordinarily be outside the stimulus presentation zone [21, 24]. Second, the presence or absence of a scotoma affects mostly the signal amplitude while the temporal dynamics of the modulation pattern are not affected. As pRF estimates are mostly invariant to the BOLD amplitude, the pRF model does not properly capture the effect of the scotoma. These two factors induce biases in the pRF estimates that can be wrongly interpreted as signs of neuroplasticity (see Box 2).
Nevertheless, changes in the BOLD signal may be used as an alternative assessment for nonfunctional parts of the visual system in patients that are unable to perform standard ophthalmic examinations, e.g., infants or patients with nystagmus [25–27]. However, because of the above aspects, caution is warranted when interpreting such data. Eye movements may affect the pRF estimates substantially, resulting in noisy maps and increased pRF sizes [28–30]. This is particularly relevant for developmental disorders such as amblyopia [5, 31–33]. In addition, pRF mapping is most accurate at an advanced stage of ophthalmologic disease where the visual field defects are relatively large and the scotomatic edge (i.e., the transition between healthy visual cortex and damaged visual cortex) is sharp [34, 35]. Overall, this inability to accurately detect small visual field defects implies that the sensitivity of the pRF approach is too limited to monitor the effects of slow retinal degeneration or slow cortical changes that would presumably be associated with rehabilitation therapies or other procedures to restore visual functioning.
2.2. Different Stimulus Properties Result in Distinct pRF Properties in Healthy Human Observers
An additional factor to be considered when interpreting pRF estimates is that the pRF represents the cumulative response across all neuronal subpopulations within a voxel. These subpopulations are selectively sensitive to spatial properties, such as orientation, color, luminance, and temporal and spatial frequencies. Hence, their activity can be driven by specific stimuli. In pRF mapping, manipulating the carrier—the stimulus aperture which drives the neuronal activity—elicits responses from a particular neuronal population. By selectively stimulating these neuronal populations, a number of recent studies have shown that compared to the standard stimulus (flickering luminance contrast checkerboard bar), pRF estimates shift in position and change their size [36–39]. These studies indicate that the recruitment of neural resources depends on the task and that there is a dependency of the retinotopic maps on the task or stimulus. This type of stimulus selectivity captures the neuronal population characteristics for features such as luminance, orientation, or words. In contrast, Welbourne and colleagues  found no difference in pRF estimates when using chromatic and achromatic stimuli. This implies that for color, there may be a decoupling between the pRF measurement and the underlying neuronal populations .
The spatial distribution of the receptive fields can also be modelled by attention. A series of studies manipulating spatial and feature-based attention found that the neuronal resources are shifted towards the attended positions [30, 41, 42].
These findings imply one of two things: (1) the topography of the visual cortex is flexible and may change in response to environmental (stimulus, task) as well as cognitive factors such as attention or (2) pRF measures are inaccurate and may change in response to spatial and cognitive factors. Either of these explanations limits the ability of the pRF approach to provide a straightforward assessment of neuroplasticity.
3. Improving Stimulus-Driven Approaches
We consider various ways in which the pRF method might be improved to study neuroplasticity. Of note are models that provide information on the reliability of the pRF-estimated properties. As a further incentive, we propose a new pRF model that incorporates cortical temporal dynamics and which integrates connectivity and topography.
Given the limitations mentioned above, this raises the question whether and how the pRF approach can be modified to render it more suitable to track neuroplastic changes. As was indicated, mimicking visual field defects can alter pRF properties in a similar manner to patients. At the minimum, this requires creating elaborated control stimulus conditions (simulations) that exactly mimic patient conditions. Unfortunately, this is often impossible to achieve. Deviations of parameter estimates in the patient group from those control values could be an indication of neuroplasticity. However, obtaining good simulations is not trivial. Thus far, the simulations that have been used have generally been quite simple, i.e., mimicking scotomas in which no light sensitivity remained—usually simulated as a region without signal modulation. However, the perceptual awareness of natural scotomas may be substantially different from that of artificial ones. For example, when the visual input is incomplete, the visual system appears to fill in any missing features (through prediction and interpolation) in order to build a stable percept. Moreover, scotomas in patients are usually more complex than simulated ones, both in their shape and their depth (reduced sensitivity). Finally, the scotoma may also change the attentional deployment by the patient, potentially affecting the estimated pRF properties [30, 41, 42].
In order to accurately measure neuronal reorganization, it is crucial to overcome the abovementioned limitations. A significant amount of work has been directed towards the development of more reliable models of retinotopic mapping. The methodological advances serve three different goals, which may be useful in studying neuroplasticity: (1) improve the reliability of the estimates using more informative pRF shapes and more complex computational models, (2) measure stimulus-selective maps, which allow to capture the reorganization of specific neuronal populations, and (3) measure spatial modulation and dynamics of neuronal populations, potentially reflecting short-term neuroplastic changes.
3.1. Computational and Model Advances
Computational and model advances have been made to (a) improve the pRF shape so that it better reflects the biological structure of the RF, e.g., using a difference of Gaussian model allows to account for surround suppression , and (b) account for nonlinearities, provide distributions of property magnitudes, and capture neuronal characteristics, such as tuning curves. Such models add new pRF features which may be important to infer functional reorganization and provide a measure of the reliability of the estimates.
A different pRF shape can be an indication of neuroplasticity. Several models have been developed to account for various possible receptive field shapes: circular symmetric difference of Gaussian (DoG) functions , bilateral pRF , elliptic shape , Gabor wavelet pyramids [34, 44], and compressive spatial summation . Some reviews have discussed these methods in detail [15, 46]. However, the above models all assume some form of symmetry. Recently, data-driven models were developed that do not assume any a priori shape [47–49]. These model-free approaches are particularly relevant to measure the functioning of the visual system in patients, as plasticity may manifest as a differently shaped pRF without affecting its position or size. An example is that asymmetrical shapes capture best the pRF properties of any skewed distributions of RF within a voxel. However, even in these data-driven approaches, the estimated shape of the receptive fields remains dependent on the stimulus used.
Extending the pRF model to account for more complex RF shapes will improve its explanatory power—the model can better predict the BOLD response. However, this will not remove the issue of model bias, mentioned in Box 2. In various attempts to resolve this, computational advances were made which can be categorized into four different classes. The first class comprises nonlinear pRF models, such as a compressive spatial summation model and convex optimized pRF, which substantially increases the range of shapes that the model can describe . The second class is the development of Bayesian models. For each property, these models do not only estimate the best fitting value but a full posterior distribution as well [50, 51]. This serves several needs: (a) it indicates the uncertainty associated with each estimate (Figure 3). Such uncertainty maps are of particular importance when a visual field defect is present, as higher uncertainty will most likely be associated with model biases, (b) it facilitates the statistical analysis, and (c) it allows one to incorporate additional biological knowledge by providing prior information. An example of such a biologically based prior is that the density of cortical neurons is higher in the fovea than in the periphery [50, 51]. In combination, the above-referred three factors improve the interpretability of pRF estimates. The third class comprises the development of the feature-weighted receptive field (fwRF) models that allow capturing additional pRF parameters—such as neuronal tuning curves (e.g., the spatial frequency tuning)—through the combination of measured neural activity and visual features . Finally, the fourth class relates to methods that allow to enhance the resolution at which we can detail RF properties. Of relevance are the approaches that allow to estimate the average single-unit RF size (suRF) [49, 53] or multiunit RF (muRF) properties that can without restriction uncover the size, position, and shape of neuronal subpopulations, also when these are fragmented and dispersed in visual space [49, 53].
3.2. Models of Perception: Spatial Modulation and Dynamics
Specific models have been developed to capture short-term plasticity. Such models take into account cognitive and/or perceptual factors such as attention [30, 54] or crowding [55, 56] to understand changes in observed spatial properties or perception. Recently, Dumoulin and Knapen proposed a more complex pRF model that relates pRF changes to the underlying neural mechanisms . This very general model allows modeling and predicting dynamic changes that result from changes in the visual input. In particular, they proposed an extension of the pRF model to account for multiple neural subpopulations responding to different properties of the stimulus. Their expectation is that this will enable unravelling of the different sources of pRF plasticity.
Although there have been significant improvements in pRF models which may be able to aid in charting neuroplastic changes, in our view, this is still insufficient. There are still many constraints to be addressed, in particular, the fact that a voxel may contain a mixture of neurons with spatially distinct receptive fields. This is particularly relevant in developmental disorders such as albinism and achiasma [9, 10] or for voxels located in sulci. In those cases, the measured pRF properties will either represent the strongest contributing RF or be erroneously large.
In our view, the neuronal spatiotemporal dynamics can be better captured if we would take into account the interactions with nearby linked populations. The connectivity-weighted pRF, described next, is a first attempt to integrate models of cortical organization with cortical connectivity. This further encourages the development of new models that integrate stimulus- and cortex-referred methods.
3.3. The Connectivity-Weighted pRF Integrates Cortical Organization and Connectivity
Current analytical approaches to track retinotopic changes are voxel based. This limits their accuracy, as the visual system is dynamic and the activity of one population of neurons is influenced by nearby connected populations. Ideally, a more complete model should reflect the balance between inhibitory and excitatory processes and account for various cortico-cortical interactions.
Here—as an example of such a model—we propose a stimulus-driven pRF model, in which the estimated parameters, , depend upon the unique activity of the neuronal population and the activity of interacting cortical neuronal populations, weighted by the strength of their connections, . Note that is the error associated with voxel .
Depending on the goal of the study and the design of the experiment, the connectivity () can be based either on the structure (anatomically connected neighbors), on function (neuronal populations which exhibit specific correlated activity during the resting state), or on effective connectivity . Here, we treat it as effective connectivity given that it accounts for dynamic interactions and the model of coupling between neuronal populations.
Such a model can describe the spatiotemporal dynamics of neuronal populations. It is sensitive to the recurrent flow of synchronized activity between connected neurons. Using such a connectivity-weighted model, we may—in the future—assess brain plasticity based on both structural reorganization and functional reorganization.
4. Cortical Circuitry Models Look beyond the Stimulus
We suggest that models that can be estimated without requiring visual stimulation, which we refer to as cortical circuitry models (CCM), may be highly suitable to measure cortical reorganization. While not without potential pitfalls themselves, such approaches avoid many of the complications associated with the stimulus-driven pRF approach. Additionally, we indicate various other avenues that may improve our ability to quantitatively assess neuroplastic changes in the visual cortex.
4.1. Studying Neuroplasticity Using Intrinsic Signals and Cortical Circuitry Models
The fMRI signal is a mixture of stimulus-specific and intrinsic signals [57, 58]. As a result, it is plausible to assume that intrinsic generated signals may influence stimulus-driven signals [57, 58]. Therefore, the study of brain plasticity may be ameliorated and/or complemented if the dependence on stimuli is reduced. For this reason, estimates based on intrinsic signals rather than task responses are potentially a very suitable source of information on the presence or absence of cortical plasticity. Intrinsic signals are commonly obtained in a “resting-state” condition in which participants are not required to do anything in particular and usually have their eyes closed. Resting-state fMRI signal fluctuations have been shown to correlate with anatomically and functionally connected areas of the brain. In particular, specialized networks have been found in cortical and subcortical areas in sensory systems [59–64]. Based on resting-state data, CCMs can be used to infer the integration of feedback and feedforward information . However, one important limitation is that currently, the directionality of information flow cannot be directly inferred from the BOLD signal. Therefore, primarily because of the limited temporal resolution of fMRI, it remains to be determined whether CCMs can be used to assess this aspect.
Nonetheless, CCMs have the potential to capture the effects of structural reorganization and can inform about which neural circuits have the potential to reorganize and which are stable. An example of this type of model is the connective field (CF) model, which applies the notion of a receptive field to cortico-cortical connections . Another example is the connectopic model which combines voxel-wise connectivity “fingerprints” with spatial statistical inference to detail multiple overlapping connection topographies (connectopies) in the human brain [66, 67]. Ultimately, in our view, it will be essential to combine retinotopic and neural circuitry models, such that their combination can be used to fully describe the dynamics of the visual cortex . To accomplish this, models will have to be developed that can capture the (dynamic) adaptation of feedback, feedforward, and lateral connections in the functional networks underlying visual processing and cognition. Such models may be implemented by calculating the correlation between neuronal populations taking time lags into account or by using CCM to describe connections across cortical layers (see also below).
4.2. The Connective Field Defines a Receptive Field in Cortical Surface Space
Connective field (CF) modeling predicts the neuronal activity in a target area (e.g., V2) based on the activity in a source area (e.g., V1). In a similar way that a neuron has a preferred location and size in visual space (its receptive field), it also will have a preferred location and size on the cortical surface of a region that it is connected with [65, 66, 68]. Based on retinotopic mapping, the visual field coordinates of the target area can be inferred from the preferred locations in the source region. In this way, the connective field—when combined with pRF mapping—can link a CF’s position in cortical surface space also to a position in visual space. The connective field model is briefly described in Box 3.
There are several advantages of CCMs when compared to pRF models. First, the ability to assess and compare the fine-grained topographic organization of cortical areas promotes the comparison of connectivity patterns between groups of participants with different health conditions and between experimental conditions [67, 70]. Second, CCMs can even be applied to data that was acquired in the absence of any sensory input, enabling the reconstruction of visuotopic maps even in the absence of a stimulus and in blind people. Several studies have shown that cortical connectivity during the resting state reflects the visuotopic organization of the visual cortex [65, 67, 70–73]. A comparison between stimulus-driven and resting-state CCMs may also convey information on the influence of retinal waves and prior visual experience in the cortical circuitry. For example, larger CF sizes were measured with visual stimulation when compared to the resting state [65, 73, 74]. Third, CCMs provide insight into the anatomical and functional neuronal circuitry that enables the visual system to integrate information across different cortical areas. They can reveal the presence or absence of a change therein following a disease [74–76]. Fourth, CCMs, in particular when assessed in the resting state, are less affected by various intrinsic and extrinsic factors such as the type of task and stimulus [37–39], patient performance, optical properties and health condition of the eye , or stimulus-related model-fitting biases [22, 77].
Despite these important advantages, the current CCM approaches also have their limitations. First, the reliability of CCM parameters, such as the CF size, is affected by the signal-to-noise ratio. Fortunately, the signal-to-noise ratio does not introduce a systematic bias in the estimated parameters [74–76]. Second, the current iteration of CCM models does not capture causal interactions between different cortical visual areas. Third, like pRF estimates, it is likely that the accuracy of the CCM-related estimates depends on the spatial and temporal resolution, the distortion and spatial spread of the BOLD signal, and the distribution of dural venous sinuses and vessel artifacts. Fourth, although there is no need for stimulus-driven signals, resting state signals—and thus also any estimated CCM properties—are influenced by the environmental conditions under which they were acquired. Factors such as eye movements and exterior luminance may also influence estimates. These limitations demonstrate that although the CCM approach seems suitable to infer the presence or absence of plasticity by associating connectivity strength with cortical degeneration , it still requires careful experimentation as well.
Some of the above limitations have recently been addressed. For example, global search algorithms that help to avoid local minima have also been applied to CCMs [74, 75]. Furthermore, new data-driven methods are able to measure multiple and even overlapping connectopies . Although, currently establishing these connectopic maps requires a very large number of participants, they hold a promise of being able to reveal cortical and network reorganization and plasticity one day .
4.3. Cortical Circuitry Models in Ophthalmic or Neurological Diseases
The development of CCMs is a sequel to the classical pRF mapping. Hence, the available literature is still relatively small. Nonetheless, the existing studies give a good impression of the possible applications and the type of information that these models can provide.
At this point in time, in particular, the CF modeling approach has been applied in several ophthalmic disorders, in which visual perception was either impaired or completely absent. A study by Haak and colleagues found that in macular degeneration, long-term deprivation of visual input had not affected the underlying cortical circuitry . This suggests that the visual cortex retains the ability to process visual information. In principle, following the restoration of visual input, i.e., via retinal implants, such patients may thus recuperate from vision loss. Papanikolaou and collaborators applied CF modeling to study the organization of area hV5/MT+ in five patients with large visual field defects resulting from either early visual areas or optic radiation lesions . They showed that in three of the five subjects, the CFs between areas V1 and hV5/MT+ covered visual field locations that overlapped with the scotoma. This indicates that activity in the lesion projection zone in hV5/MT+ may originate from spared V1. Bock and collaborators applied the CF model to resting-state BOLD data acquired from normally sighted, early blind, and monocular patients in which one of the eyes had failed to develop . All subjects showed retinotopic organization between V1 and V2/V3. Butt and colleagues studied the cortical circuitry of the visual cortex in blind observers and compared this to that of sighted controls [70, 74]. They found a very minute change in the pattern of fine-scale striate correlations between hemispheres, in contrast to the highly similar connectivity pattern within hemisphere. They concluded that the cortical connections within a region (which can be a hemisphere) are independent of visual experience. The above-cited studies show that, in general, the visuotopic organization of the cortical circuitry is maintained even after prolonged visual deprivation or blindness, supporting that the plasticity of the adult visual brain is limited (see Wandell and Smirnakis for a similar conclusion based on stimulus-driven mapping ). Moreover, these studies suggest that CCMs may be able to capture the integrity of cortical connections using both stimulus-driven and resting-state data. This encourages the development of new CCMs that can be applied to study how connected neurons in different layers and columns interact.
4.4. Mesoscale Plasticity: Layer- and Column-Based Cortical Circuitry Models
Measuring cortical reorganization at a finer scale might reveal changes that are invisible or masked at a coarser scale. With the recent advance in ultra-high field functional MRI, the tools to examine the human brain at a mesoscale in vivo have become available. This enables assessing the presence of cortical reorganization across cortical depth to measure the flow of information across different cortical laminae—in particular feedback and lateral inputs—and to infer the microcortical circuits by studying their columnar organization.
Many of the opportunities and challenges in visual neuroscience provided by increases in MRI field strength have been described in a recent review, to which we refer . With respect to the topic of neuroplasticity, a study that showed that pRF in the input (middle) layer have a smaller RF than those in superficial and deeper intracortical layers is of particular interest . Although this study provides hints about cortical organization, it exclusively relied on stimulus-based modelling and thus does not truly inform about the underlying circuitry. In order to bridge this gap, we propose that the application of CCM-like approaches to study short-range connections at laminar and columnar levels is warranted.
The development of methods that reflect the mesoscale circuitry should be able to answer various outstanding critical questions in visual neuroscience and contribute with new fundamental and clinically relevant insights into cortical functioning and neuroplasticity. For example, following a visual field defect, is the input/feedforward layer the one that is most affected? Do neurons in the upper and deepest layers of the lesion projection zone establish new connections to healthy neurons in the input layer? At what level of cortical processing do feedback and feedforward signals modulate our conscious percepts? Are putative overlapping representations in ventral areas  perhaps encoded in distinct layers of the visual cortex?
In this paper, we discussed (a) the role of pRF mapping to cortically characterize visual areas and extrinsic and intrinsic factors that influence the pRF estimates, (b) methodological advances in retinotopic and connectopic mapping, and (c) stimulus-driven and cortical circuitry models that can link visual cortex organization, dynamics, and plasticity.
Although we fully acknowledge the important contribution of pRF mapping towards understanding the structure and functioning of the visual cortex, we strongly argue against a “blind” reliance on this technique when studying neuroplasticity. The degree to which a change in signal amplitude or pRF measurements—by themselves—reflects that cortical reorganization remains to be determined: even in the presence of a presumed stable cortical organization in healthy participants, different pRF estimates may be elicited due to a change in the task at hand, cognitive factors, and the type of stimulus used. For this reason, we have stressed that prior to deciding that pRF changes are the result of reorganization, one has to exclude that these are due to different inputs, (implicit) task conditions, or cognitive demands.
To improve the reliability of retinotopic mapping, more complex models and computational approaches have been developed with a noticeable trend to move from stimulus-driven to data-driven techniques. These efforts have resulted in a multitude of new methods. Their specific use depends upon the goal of the study and the neuronal population of interest. Nevertheless, although these newer techniques provide clear improvements, they potentially retain the issues associated with stimulus-driven approaches. Therefore, we argue in favor of also considering alternative techniques to study brain plasticity, in particular ones that directly assess the neural circuitry rather than stimulus-driven responses to estimate the extent of neuronal reorganization. As an exemplary incentive, we propose a model that combines connectivity with spatial sampling. In theory, such a model will not only inform about the spatial sampling but also about interactions between the linked neuronal populations. Finally, we encourage the development and application of models to capture the plasticity of layer-based circuitry at the mesoscale.
The funding organizations had no role in the design, conduct, analysis, or publication of this research.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
JC was supported by the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement no 641805. FWC was supported by the Netherlands Organization for Scientific Research (NWO Brain and Cognition grant 433-09-233).
- A. J. ROCKEL, R. W. HIORNS, and T. P. S. POWELL, “The basic uniformity in structure of the neocortex,” Brain, vol. 103, no. 2, pp. 221–244, 1980.
- G. Leuba and L. J. Garey, “Comparison of neuronal and glial numerical density in primary and secondary visual cortex of man,” Experimental Brain Research, vol. 77, no. 1, pp. 31–38, 1989.
- S. O. Dumoulin and B. A. Wandell, “Population receptive field estimates in human visual cortex,” NeuroImage, vol. 39, no. 2, pp. 647–660, 2008.
- B. A. Wandell and S. M. Smirnakis, “Plasticity and stability of visual field maps in adult primary visual cortex,” Nature Reviews Neuroscience, vol. 10, no. 12, pp. 873–884, 2009.
- S. Clavagnier, S. O. Dumoulin, and R. F. Hess, “Is the cortical deficit in amblyopia due to reduced cortical magnification, loss of neural resolution, or neural disorganization?” Journal of Neuroscience, vol. 35, no. 44, pp. 14740–14755, 2015.
- D. S. Schwarzkopf, E. J. Anderson, B. de Haas, S. J. White, and G. Rees, “Larger extrastriate population receptive fields in autism spectrum disorders,” The Journal of Neuroscience, vol. 34, no. 7, pp. 2713–2724, 2014.
- E. J. Anderson, M. S. Tibber, D. S. Schwarzkopf et al., “Visual population receptive fields in people with schizophrenia have reduced inhibitory surrounds,” The Journal of Neuroscience, vol. 37, no. 6, pp. 1546–1556, 2017.
- K. Ahmadi, A. Fracasso, J. A. van Dijk et al., “Altered organization of the visual cortex in FHONDA syndrome,” NeuroImage, vol. 190, pp. 224–231, 2019.
- M. B. Hoffmann, D. J. Tolhurst, A. T. Moore, and A. B. Morland, “Organization of the visual cortex in human albinism,” The Journal of Neuroscience, vol. 23, no. 26, pp. 8921–8930, 2003.
- M. B. Hoffmann, F. R. Kaule, N. Levin et al., “Plasticity and stability of the visual system in human achiasma,” Neuron, vol. 75, no. 3, pp. 393–401, 2012.
- A. Fracasso, Y. Koenraads, G. L. Porro, and S. O. Dumoulin, “Bilateral population receptive fields in congenital hemihydranencephaly,” Ophthalmic & Physiological Optics, vol. 36, no. 3, pp. 324–334, 2016.
- L. Muckli, M. J. Naumer, and W. Singer, “Bilateral visual field maps in a patient with only one hemisphere,” Proceedings of the National Academy of Sciences, vol. 106, no. 31, pp. 13034–13039, 2009.
- K. V. Haak, D. R. M. Langers, R. Renken, P. van Dijk, J. Borgstein, and F. W. Cornelissen, “Abnormal visual field maps in human cortex: a mini-review and a case report,” Cortex, vol. 56, pp. 14–25, 2014.
- I. P. Conner, J. V. Odom, T. L. Schwartz, and J. D. Mendola, “Retinotopic maps and foveal suppression in the visual cortex of amblyopic adults,” The Journal of Physiology, vol. 583, no. 1, pp. 159–173, 2007.
- S. O. Dumoulin and T. Knapen, “How visual cortical organization is altered by ophthalmologic and neurologic disorders,” Annual Review of Vision Science, vol. 4, no. 1, pp. 357–379, 2018.
- A. Herro and B. L. Lam, “Retrograde degeneration of retinal ganglion cells in homonymous hemianopsia,” Clinical Ophthalmology, vol. 2015, no. 9, pp. 1057–1064, 2015.
- A. Cowey, I. Alexander, and P. Stoerig, “Transneuronal retrograde degeneration of retinal ganglion cells and optic tract in hemianopic monkeys and humans,” Brain, vol. 134, no. 7, pp. 2149–2157, 2011.
- M. Senden, J. Reithler, S. Gijsen, and R. Goebel, “Evaluating population receptive field estimation frameworks in terms of robustness and reproducibility,” PLoS One, vol. 9, no. 12, article e114054, 2014.
- J. A. van Dijk, B. de Haas, C. Moutsiana, and D. S. Schwarzkopf, “Intersession reliability of population receptive field estimates,” NeuroImage, vol. 143, pp. 293–303, 2016.
- H. A. Baseler, A. Gouws, K. V. Haak et al., “Large-scale remapping of visual cortex is absent in adult humans with macular degeneration,” Nature Neuroscience, vol. 14, no. 5, pp. 649–655, 2011.
- K. V. Haak, F. W. Cornelissen, and A. B. Morland, “Population receptive field dynamics in human visual cortex,” PLoS One, vol. 7, no. 5, article e37686, 2012.
- P. Binda, J. M. Thomas, G. M. Boynton, and I. Fine, “Minimizing biases in estimating the reorganization of human visual areas with BOLD retinotopic mapping,” Journal of Vision, vol. 13, no. 7, p. 13, 2013.
- B. Barton and A. A. Brewer, “fMRI of the rod scotoma elucidates cortical rod pathways and implications for lesion measurements,” Proceedings of the National Academy of Sciences of the United States of America, vol. 112, no. 16, pp. 5201–5206, 2015.
- M. Senden, “Real Time Estimation of Population Receptive Fields Using Gradient Descent,” bioRxiv, p. 194621, 2017.
- M. M. Souweidane, K. H. S. Kim, R. McDowall et al., “Brain mapping in sedated infants and young children with passive-functional magnetic resonance imaging,” Pediatric Neurosurgery, vol. 30, no. 2, pp. 86–92, 1999.
- G. Qing, S. Zhang, B. Wang, and N. Wang, “Functional MRI signal changes in primary visual cortex corresponding to the central normal visual field of patients with primary open-angle glaucoma,” Investigative Ophthalmology & Visual Science, vol. 51, no. 9, pp. 4627–4634, 2010.
- K. N. Engin, B. Yemişci, S. T. Bayramoğlu et al., “Structural and functional evaluation of glaucomatous neurodegeneration from eye to visual cortex using 1.5T MR imaging: A Pilot Study,” Journal of Clinical & Experimental Ophthalmology, vol. 05, no. 03, 2014.
- A. Hummer, M. Ritter, M. Tik et al., “Eyetracker-based gaze correction for robust mapping of population receptive fields,” NeuroImage, vol. 142, pp. 211–224, 2016.
- N. Levin, S. O. Dumoulin, J. Winawer, R. F. Dougherty, and B. A. Wandell, “Cortical maps and white matter tracts following long period of visual deprivation and retinal image restoration,” Neuron, vol. 65, no. 1, pp. 21–31, 2010.
- B. P. Klein, B. M. Harvey, and S. O. Dumoulin, “Attraction of position preference by spatial attention throughout human visual cortex,” Neuron, vol. 84, no. 1, pp. 227–237, 2014.
- G. Gingras, D. E. Mitchell, and R. F. Hess, “Haphazard neural connections underlie the visual deficits of cats with strabismic or deprivation amblyopia,” The European Journal of Neuroscience, vol. 22, no. 1, pp. 119–124, 2005.
- X. Li, S. O. Dumoulin, B. Mansouri, and R. F. Hess, “The fidelity of the cortical retinotopic map in human amblyopia,” European Journal of Neuroscience, vol. 25, no. 5, pp. 1265–1277, 2007.
- R. Farivar, J. Zhou, Y. Huang, L. Feng, Y. Zhou, and R. F. Hess, “Two cortical deficits underlie amblyopia: a multifocal fMRI analysis,” NeuroImage, vol. 190, pp. 232–241, 2019.
- E. H. Silson, T. S. Aleman, A. Willett et al., “Comparing clinical perimetry and population receptive field measures in patients with choroideremia,” Investigative Ophthalmology & Visual Science, vol. 59, no. 8, pp. 3249–3258, 2018.
- M. Ritter, A. Hummer, A. A. Ledolter, G. E. Holder, C. Windischberger, and U. M. Schmidt-Erfurth, “Correspondence between retinotopic cortical mapping and conventional functional and morphological assessment of retinal disease,” The British Journal of Ophthalmology, vol. 103, no. 2, pp. 208–215, 2019.
- T. S. Lee and M. Nguyen, “Dynamics of subjective contour formation in the early visual cortex,” Proceedings of the National Academy of Sciences of the United States of America, vol. 98, no. 4, pp. 1907–1911, 2001.
- S. O. Dumoulin, R. F. Hess, K. A. May, B. M. Harvey, B. Rokers, and M. Barendregt, “Contour extracting networks in early extrastriate cortex,” Journal of Vision, vol. 14, no. 5, p. 18, 2014.
- F. Yildirim, J. Carvalho, and F. W. Cornelissen, “A second-order orientation-contrast stimulus for population-receptive-field-based retinotopic mapping,” NeuroImage, vol. 164, pp. 183–193, 2018.
- R. Le, N. Witthoft, M. Ben-Shachar, and B. Wandell, “The field of view available to the ventral occipito-temporal reading circuitry,” Journal of Vision, vol. 17, no. 4, p. 6, 2017.
- L. E. Welbourne, A. B. Morland, and A. R. Wade, “Population receptive field (pRF) measurements of chromatic responses in human visual cortex using fMRI,” NeuroImage, vol. 167, pp. 84–94, 2018.
- B. P. Klein, A. Fracasso, J. A. van Dijk, C. L. E. Paffen, S. F. Te Pas, and S. O. Dumoulin, “Cortical depth dependent population receptive field attraction by spatial attention in human V1,” NeuroImage, vol. 176, pp. 301–312, 2018.
- D. M. van Es, J. Theeuwes, and T. Knapen, “Spatial sampling in human visual cortex is modulated by both spatial and feature-based attention,” eLife, vol. 7, 2018.
- W. Zuiderbaan, B. M. Harvey, and S. O. Dumoulin, “Modeling center-surround configurations in population receptive fields using fMRI,” Journal of Vision, vol. 12, no. 3, p. 10, 2012.
- K. N. Kay, T. Naselaris, R. J. Prenger, and J. L. Gallant, “Identifying natural images from human brain activity,” Nature, vol. 452, no. 7185, pp. 352–355, 2008.
- K. N. Kay, J. Winawer, A. Mezer, and B. A. Wandell, “Compressive spatial summation in human visual cortex,” Journal of Neurophysiology, vol. 110, no. 2, pp. 481–494, 2013.
- B. A. Wandell and J. Winawer, “Computational neuroimaging and population receptive fields,” Trends in Cognitive Sciences, vol. 19, no. 6, pp. 349–357, 2015.
- C. A. Greene, S. O. Dumoulin, B. M. Harvey, and D. Ress, “Measurement of population receptive fields in human early visual cortex using back-projection tomography,” Journal of Vision, vol. 14, no. 1, 2014.
- S. Lee, A. Papanikolaou, N. K. Logothetis, S. M. Smirnakis, and G. A. Keliris, “A new method for estimating population receptive field topography in visual cortex,” NeuroImage, vol. 81, pp. 144–157, 2013.
- J. Carvalho, A. Invernizzi, K. Ahmadi, M. B. Hoffmann, and F. W. Cornelissen, “Micro-probing enables high-resolution mapping of neuronal subpopulations using fMRI,” BioRxiv, p. 709006, 2019.
- P. Zeidman, E. H. Silson, D. S. Schwarzkopf, C. I. Baker, and W. Penny, “Bayesian population receptive field modelling,” NeuroImage, vol. 180, pp. 173–187, 2018.
- S. Adaszewski, D. Slater, L. Melie-Garcia, B. Draganski, and P. Bogorodzki, “Simultaneous estimation of population receptive field and hemodynamic parameters from single point BOLD responses using Metropolis-Hastings sampling,” NeuroImage, vol. 172, pp. 175–193, 2018.
- G. St-Yves and T. Naselaris, “The feature-weighted receptive field: an interpretable encoding model for complex feature spaces,” NeuroImage, vol. 180, pp. 188–202, 2017.
- G. A. Keliris, Q. Li, A. Papanikolaou, N. K. Logothetis, and S. M. Smirnakis, “Estimating average single-neuron visual receptive field sizes by fMRI,” Proceedings of the National Academy of Sciences of the United States of America, vol. 116, no. 13, pp. 6425–6434, 2019.
- A. Yoonessi and A. Yoonessi, “Functional assessment of magno, parvo and konio-cellular pathways; current state and future clinical applications,” Journal of Ophthalmic & Vision Research, vol. 6, no. 2, pp. 119–126, 2011.
- R. van den Berg, J. B. T. M. Roerdink, and F. W. Cornelissen, “A neurophysiologically plausible population code model for feature integration explains visual crowding,” PLoS Computational Biology, vol. 6, no. 1, article e1000646, 2010.
- A. Grillini, R. Renken, N. Jansonius, and F. Cornelissen, “Perceptual learning following visual search decreases peripheral visual crowding,” Perception, vol. 45, p. 226, 2016.
- M. Gilson, R. Moreno-Bote, A. Ponce-Alvarez, P. Ritter, and G. Deco, “Estimation of directed effective connectivity from fMRI functional connectivity hints at asymmetries of cortical connectome,” PLoS Computational Biology, vol. 12, no. 3, article e1004762, 2016.
- A. M. Albers, T. Meindertsma, I. Toni, and F. P. de Lange, “Decoupling of BOLD amplitude and pattern classification of orientation-selective activity in human visual cortex,” NeuroImage, vol. 180, pp. 31–40, 2018.
- C. F. Beckmann, M. DeLuca, J. T. Devlin, and S. M. Smith, “Investigations into resting-state connectivity using independent component analysis,” Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, vol. 360, no. 1457, pp. 1001–1013, 2005.
- B. Biswal, F. Zerrin Yetkin, V. M. Haughton, and J. S. Hyde, “Functional connectivity in the motor cortex of resting human brain using echo-planar mri,” Magnetic Resonance in Medicine, vol. 34, no. 4, pp. 537–541, 1995.
- D. Cordes, V. M. Haughton, K. Arfanakis et al., “Mapping functionally related regions of brain with functional connectivity MR imaging,” AJNR. American Journal of Neuroradiology, vol. 21, no. 9, pp. 1636–1644, 2000.
- J. S. Damoiseaux, S. A. R. B. Rombouts, F. Barkhof et al., “Consistent resting-state networks across healthy subjects,” Proceedings of the National Academy of Sciences of the United States of America, vol. 103, no. 37, pp. 13848–13853, 2006.
- T. Stein, C. Moritz, M. Quigley, D. Cordes, V. Haughton, and E. Meyerand, “Functional connectivity in the thalamus and hippocampus studied with functional MR imaging,” AJNR. American Journal of Neuroradiology, vol. 21, no. 8, pp. 1397–1401, 2000.
- D. M. Cole, S. M. Smith, and C. F. Beckmann, “Advances and pitfalls in the analysis and interpretation of resting-state FMRI data,” Frontiers in Systems Neuroscience, vol. 4, p. 8, 2010.
- N. Gravel, B. Harvey, B. Nordhjem et al., “Cortical connective field estimates from resting state fMRI activity,” Frontiers in Neuroscience, vol. 8, p. 339, 2014.
- K. V. Haak, J. Winawer, B. M. Harvey et al., “Connective field modeling,” NeuroImage, vol. 66, pp. 376–384, 2013.
- K. V. Haak, A. F. Marquand, and C. F. Beckmann, “Connectopic mapping with resting-state fMRI,” NeuroImage, vol. 170, pp. 83–94, 2018.
- B. A. Wandell and R. K. Le, “Diagnosing the neural circuitry of reading,” Neuron, vol. 96, no. 2, pp. 298–311, 2017.
- E. W. Dijkstra, “A note on two problems in connexion with graphs,” Numerische Mathematik, vol. 1, no. 1, pp. 269–271, 1959.
- O. H. Butt, N. C. Benson, R. Datta, and G. K. Aguirre, “The fine-scale functional correlation of striate cortex in sighted and blind people,” The Journal of Neuroscience, vol. 33, no. 41, pp. 16209–16219, 2013.
- J. Heinzle, T. Kahnt, and J.-D. Haynes, “Topographically specific functional connectivity between visual field maps in the human brain,” NeuroImage, vol. 56, no. 3, pp. 1426–1436, 2011.
- T. H. Donner, D. Sagi, Y. S. Bonneh, and D. J. Heeger, “Retinotopic patterns of correlated fluctuations in visual cortex reflect the dynamics of spontaneous perceptual suppression,” The Journal of Neuroscience, vol. 33, no. 5, pp. 2188–2198, 2013.
- M. Raemaekers, W. Schellekens, R. J. A. van Wezel, N. Petridou, G. Kristo, and N. F. Ramsey, “Patterns of resting state connectivity in human primary visual cortical areas: a 7T fMRI study,” NeuroImage, vol. 84, pp. 911–921, 2014.
- A. S. Bock, P. Binda, N. C. Benson, H. Bridge, K. E. Watkins, and I. Fine, “Resting-state retinotopic organization in the absence of retinal input and visual experience,” The Journal of Neuroscience, vol. 35, no. 36, pp. 12366–12382, 2015.
- K. V. Haak, A. B. Morland, G. S. Rubin, and F. W. Cornelissen, “Preserved retinotopic brain connectivity in macular degeneration,” Ophthalmic & Physiological Optics, vol. 36, no. 3, pp. 335–343, 2016.
- A. Papanikolaou, G. A. Keliris, T. Dorina Papageorgiou, U. Schiefer, N. K. Logothetis, and S. M. Smirnakis, “Organization of Area hV5/MT+ in Subjects with Homonymous Visual Field Defects,” NeuroImage, vol. 190, no. 15, pp. 254–268, 2018.
- Â. S. C. Miranda, A. d. F. Martins Rosa, M. J. Patrício Dias et al., “Optical properties influence visual cortical functional resolution after cataract surgery and both dissociate from subjectively perceived quality of vision,” Investigative Opthalmology & Visual Science, vol. 59, no. 2, pp. 986–994, 2018.
- S. O. Dumoulin, A. Fracasso, W. van der Zwaag, J. C. W. Siero, and N. Petridou, “Ultra-high field MRI: advancing systems neuroscience towards mesoscopic human brain function,” NeuroImage, vol. 168, pp. 345–357, 2018.
- A. Fracasso, N. Petridou, and S. O. Dumoulin, “Systematic variation of population receptive field properties across cortical depth in human visual cortex,” NeuroImage, vol. 139, pp. 427–438, 2016.
Copyright © 2019 Joana Carvalho et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.