Computational Techniques for Eye Movements Analysis towards Supporting Early Diagnosis of Alzheimer’s Disease: A Review

Beltrán, Jessica; García-Vázquez, Mireya S.; Benois-Pineau, Jenny; Gutierrez-Robledo, Luis Miguel; Dartigues, Jean-François

doi:https://doi.org/10.1155/2018/2676409

Computational and Mathematical Methods in Medicine

On this page

Abstract Introduction Data Collection Conclusions Conflicts of Interest Acknowledgments References Copyright Related Articles

Special Issue

Computational Tools and Techniques for Early Diagnosis and Screening of Geriatric Diseases

View this Special Issue

Review Article | Open Access

Volume 2018 | Article ID 2676409 | https://doi.org/10.1155/2018/2676409

Computational Techniques for Eye Movements Analysis towards Supporting Early Diagnosis of Alzheimer’s Disease: A Review

Jessica Beltrán,^1,2Mireya S. García-Vázquez,¹Jenny Benois-Pineau,³Luis Miguel Gutierrez-Robledo,⁴and Jean-François Dartigues⁵

Academic Editor: Hyuntae Park

Received03 Nov 2017

Accepted03 Apr 2018

Published20 May 2018

Abstract

An opportune early diagnosis of Alzheimer’s disease (AD) would help to overcome symptoms and improve the quality of life for AD patients. Research studies have identified early manifestations of AD that occur years before the diagnosis. For instance, eye movements of people with AD in different tasks differ from eye movements of control subjects. In this review, we present a summary and evolution of research approaches that use eye tracking technology and computational analysis to measure and compare eye movements under different tasks and experiments. Furthermore, this review is targeted to the feasibility of pioneer work on developing computational tools and techniques to analyze eye movements under naturalistic scenarios. We describe the progress in technology that can enhance the analysis of eye movements everywhere while subjects perform their daily activities and give future research directions to develop tools to support early AD diagnosis through analysis of eye movements.

1. Introduction

Neurodegenerative diseases are a group of disorders characterized by the progressive degeneration of the neurons of the central or peripheral nervous systems. The degeneration affects neuron synapsis or produces neuron death [1]. The most frequent neurodegenerative diseases are Alzheimer’s disease (AD) and Parkinson disease (PD) [2, 3]. According to the Alzheimer’s Association (https://www.alz.org/), currently there are 5.7 million people living with AD only in the US and it is expected that this number would increase to 13.8 million by 2050 [4]. Although there is no cure for AD [5], several treatments have been tested [6], for example, currently approved drugs such as donepezil, galantamine, and rivastigmine [7] and nonpharmacologic therapies [4].

Alzheimer’ disease is frequently diagnosed at late stages when symptoms have become evident, which occurs after a process of months or years of neuron degeneration [6]. However, when diagnosed at early stages, treatment helps to overcome the symptoms and improves the quality of life [2, 6] and offers to caregivers the opportunity to adapt and prepare the characteristics changes of dementia [8]. Also, the early diagnosis would allow testing the administration of more aggressive therapy to prevent AD development [9]. Despite many efforts, the noninvasive diagnosis of AD at early stages remains unsolved [5, 10].

Recent literature reviews have outlined robust findings demonstrating that eye movements abnormalities are sign of cognitive decline [11, 12] and can eventually be used to assess AD disease progression. Furthermore, current technology provides noninvasive equipment and methods to assess visual deficits ubiquitously and objectively in naturalistic scenarios [13]. An example is the use of eye trackers, which are devices that measure gaze fixation and saccadic motions of eyes. Eye trackers have been used in experiments of oculomotor performance related to AD diagnosis [14]. However, currently eye trackers have been used only in controlled laboratory settings. To analyze eye movements in naturalistic scenarios, such as in activities of daily living (ADL), besides the gaze fixation points, understanding the scene is required. The understanding of the scene can be achieved through analysis of recorded video with computer vision techniques. The computational analysis of the video, supported by the areas of psychology and neurology, allows distinguishing the items from the scenes that grab the attention of the viewer [15, 16]. This information can be used to compare the areas of interest from people with AD (PwAD) and control groups (people without AD) when observing natural scenes with a potential use in early detection.

In this paper, we firstly describe technological tools and methods that have been used to gather eye movements data. Then, we review existing research that has encountered relation between eye movements and AD. This section also describes a evolution of research on eye movements and AD since earliest research towards naturalistic scenarios more suitable for early detection. Section 4 describes computational techniques that are useful for complementing the analysis of eye movements and AD in naturalistic scenarios. Finally, Section 5 includes the conclusion and future directions.

2. Data Collection

To collect data, an important step is choosing a proper eye tracker device according to a planned research study. Eye trackers are devices that measure the point of gaze or eye movements from an individual [17]. The availability of eye movements recordings allows researchers to gather and analyze ground truth data about visual exploration [18]. This feature makes eye trackers a useful tool to study changes in cognition through eye movements analysis [19, 20]. The cognitive process are not directly measured with eye trackers. We can manipulate independent variables according to experimental design setups and measure the behavioral response from participants with eye movements measures [21].

Eye tracking provides a noninvasive tool without contraindications suitable for potential screening and tracking of AD [22]. Eye trackers provide data sensitivity that makes them suitable for analyzing oculomotor abnormalities in AD. However, there are different technological approaches for the construction of eye trackers [21]. For this reason, it is important to choose properly the adequate eye tracker features that fit the study.

Eye trackers can be static or provide mobility. For example, there are screen-based eye trackers, as the one used in [23]. These types of eye trackers are desktop mounted and collect fixation points only from the gaze towards the content displayed on a screen. Another type of eye trackers is head mounted, as the “ExpressEye” used in [19]. In this case the device allows capturing gaze fixations not limited to a specific screen; however, the user can not freely move because the apparatus is cumbersome. Nowadays, there are available commercial mobile eye trackers, such as Tobbi© (https://www.tobiipro.com) or SMI© (https://www.smivision.com) that provide continuous, remote, and pervasive capture capabilities. These capabilities are desirable to analyze eye movements from PwAD in naturalistic scenarios.

Despite capabilities provided by eye trackers, there are concerns about the use of eye trackers when participants are unrestrained [24]. The concerns are about the reliability of gaze recording when capturing data when participants take a nonoptimal pose. This later might represent a challenge in naturalistic experimental setups.

To gather data from participants in AD studies, researches divide participants into groups. Usually, the groups reported in the literature are young controls, elder controls, and PwAD. However, there are studies that also include a group people with Mild Cognitive Decline (MCI) to differentiate between persons in a more advanced stage of AD. The cognitive status from participants is usually evaluated through neuropsychological tests, such as the Mini Mental State Examination (MMSE) [12]. However, some studies have used other techniques such as thyroid function test and magnetic resonance images [11] among others.

The participants perform instructed oculomotor tasks while observing visual stimuli, such as images or video. The fixation points from the participants are collected using the chosen eye tracking device. Then, statistical tests and other modeling techniques are applied for data analysis. Finally, results are presented correlating outcome measures with a cognitive status and by showing differences among control groups and PwAD if present. In the next section different approaches that have encountered relation between eye movements and AD under different experimental setups are described.

3. Eye Movements and Alzheimer’s Disease

Several researches on predementia have reported manifestations of visual symptoms produced by senile plaques and tangles located in the visual regions of the brain [38, 39]. The pathological changes in the visual system caused by neurodegenerative diseases are reviewed in [40–43]. Examples of these pathological changes are visual acuity changes, atypical pupillary responses, and alteration in the oculomotor performance [44].

Eye movements involve a complex oculomotor control system formed by extensive cerebral regions [45]. Through post mortem studies, there is evidence that pathologies associated with AD affect the oculomotor brain regions [46, 47]. Altered eye movements patterns reflect the resulting underlying visuospatial and executive function impairments. Thus, movement patterns are related to higher cognitive control processes [48]. That is why, for example, eye movements allow exploring the cognitive process underlying visual search, providing information about how people forage and plan when performing visual search tasks [49].

Typically, the studies dedicated to explore relationships between eye movements and AD compare certain outcome measures between persons with AD (PwAD) and control groups when they accomplish a specific oculomotor tasks. Examples of these tasks are fixating on a given point [19] or watching a picture [12]. An example of a dependent variable on these studies is the reaction time to perform the given tasks.

To examine the research involving eye movements and Alzheimer’s disease, we searched in the PubMed© (https://www.ncbi.nlm.nih.gov/pubmed) database with the keywords “Alzheimer’s disease” and “Eye movements”. The database included 165 articles from 1979 to 2017. From the 165 articles, 14 are review articles and 80 articles are not related to AD; focus on atypical subsets of AD or eye movements are not part of the study. From the 165 results, we found that 71 articles are relevant to the research of oculomotor performance of AD patients. The 19.7% (14 articles) from the relevant articles were published in the last 3 years. This shows that research analyzing eye movements is gaining importance in AD studies. Furthermore, recent research shows that the analysis of oculomotor deficits is useful in early detection of AD and also has the potential to be used to assess disease progression [43, 50].

Table 1 shows a summary of the research indexed in PubMed since the last 5 years related to eye movements analysis and AD. The summary includes the references and years, the methods used by the researches, the main findings from the studies and information about the participants, and apparatus if present. In the following sections, we describe and categorize conducted research showing an evolution from early attempts towards more naturalistic scenarios.

3.1. Saccadic Eye Movements and Alzheimer’s Disease

Traditional studies using saccadic eye movements (SEM) tasks have reported differences between PwAD and control groups. A saccade is a rapid motion of the eye (typically lasting between 30 to 80 ms to complete) [21]. Example of these studies includes prosaccades and antisaccades analysis [19, 51]. To study prosaccades, a participant has to saccade from a initial point to an appearing peripheral target. Then, the reaction time or latency is measured from the subject to fixate on the presented peripheral target. The research described in [37, 52, 53] reports increased latency of saccades from PwAD when compared to control groups that can be associated with cognitive process. On the other hand, to study antisaccades, the participant must fixate an opposite direction from a presented peripheral target [54]. As the participants have to inhibit the automatic saccade towards the stimulus, the antisaccade task requires additional executive processing from participants [55]. The nature of antisaccades can be associated with executive attention and research results indicate that patients with AD have shown more antisaccade errors with fewer corrections than control groups [56]. The papers [14, 44, 48, 50] review work conducted on eye movements and their relationship with AD.

There are different challenges regarding eye movements studies and AD. The first challenge arises because oculomotor abnormalities are not exclusive from AD and it is important to develop techniques that properly distinguish AD from other diseases. For example, SEM abnormalities have been encountered in Multiple System Atrophy, such as slower prosaccade and increased antisaccade errors [57].

Furthermore, SEM abnormalities might be related to aging. For example, in [58] it is reported that latencies uncorrected or increased time to correct error in antisaccades increase with aging. Older adults appear to have stronger difficulty ignoring distractions during day-to-day activities than younger adults. It seems that any variable that reduces the strength of the top-down neural signal to produce a voluntary saccade, or that increases saccade speed, will enhance the likelihood that a reflexive saccade to a stimulus with an abrupt onset will occur [59]. So, what is the effect of “normal” aging on eye saccade speed? It has been shown [60] that the Digit Symbol Substitution Test can be altered as far as 20 years before AD in older individuals with a high level of study is manifest. The performance in this test is related to the speed of eye saccades. This decline in performance speed and executive functions might be nonspecific prodromal Alzheimer’s but could as well characterize a state of cerebral vulnerability on which the illness would progress more easily. Despite the relationship between age related cognitive decline and saccadic eye movements (SEM) deficits has been outlined, specific cognitive alterations underlying age-related changes in saccadic performance remain unclear. The nature of aging effects on SEMs has been only rarely approached. The progressive age-related decline of processing speed and executive attention is associated with and can be highlighted through saccadic age movement deficits as well in prosaccade and antisaccade tasks.

As can be see from Table 1, research from five years ago mainly focused in studying prosaccades and antisaccades. Indeed, the study of SEM was dominant since the earliest approaches dedicated to analyze eye movements and its relation to AD [52, 61–64]. As described, in SEM experiments the participants must fixate to a target. Although SEM studies have reported significant difference between persons with AD and control groups, there is still a research gap to fill in order to use SEM analysis as a marker for AD. Differentiate SEM abnormalities from AD, “normal” aging, and other conditions are among the main challenges from SEM analysis.

Prosaccade and antisaccade tasks have been popular in research studies due to their simplicity [58]. These tasks require a controlled scenario to conduct the evaluations. As research has evolved, more complex tasks have been studied towards associating eye movements deficits to support AD diagnosis. In Section 3.2 studies involving the execution of more complex tasks than attending to single target points are described. However, this research still lies in a category of controlled scenarios.

3.2. Eye Movements Analysis in Controlled Scenarios

Since the past years, research studies have moved forward to conduct other types of experiments aiming to identify eye movements abnormalities related to AD. For example, in [12] the participants performed a more complex task that only attend a target point that consisted in detecting and categorizing a specific object within a natural scene. The participants observed two visual stimuli in a monitor, one including an image with an animal and the other including a distractor image. The participants were asked to saccade to the image that contained the animal while their success to fixate to the animal and to the correct image was measured. The results from this study show that persons with AD, even in a mild stage of the disease, when compared with control groups have difficulties to select the relevant targets.

Another example is given by the work in [11] that focuses on the analysis of reading behavior of PwAD. Reading is an ADL that involves the use of working memory and memory retrieval function. Thus, the experiments in [11] involve analysis of more complex task than usual SEM studies. The experiment consisted in a comparison of the eye gaze position of PwAD and control participants when reading sentences. The findings from [11] show that PwAD have a longer gaze duration than controls. Additionally, they found that a predictability degree on the sentences is accounted by control subjects but not by PwAD. This suggests that PwAD have impairments with their working memory and memory retrieval functions. Although the work in [11] is towards analysis of eye movements in ADL, the current experiments are under controlled scenarios in the sense that use screen based eye trackers and even use a chin rest to constrain head movements. Another research studies the attention to repeated and novel stimuli [65] that is related to cognition and attention. The experiments consist in presenting slides to mild-to-moderate PwAD that contain novel and repeated images. The researchers report that fixations on the images serve to evaluate attendance to repeated and novel content providing the potential to be used to measure disease progression.

Another study analyzes the effects of AD on visual exploration [25]. The study focuses on visual search performance for target detection in the far periphery. The participants, AD patients, and control subjects explore a hemispherical screen and respond to presented targets. The results from this study show differences in AD patients and control subjects when identifying targets on different eccentricities from the screen. Researchers also report differences on target detection times and number of fixations. The work in [66] uses eye movements analysis during video watching to infer people’s cognitive function. Researches defined 13 features from fixations and found correlations between the features and memory capability. Example of these features include mean fixation duration, fixation count, and mean saccade amplitude. Different from other specific laboratory tasks, in these experiments the participants freely watch videos from different scenarios while features from eye movements are extracted.

A pilot study in France, LYLO [67], focused on measuring the rigidity and lack of curiosity of PwAD. In this study, the patients were screened in laboratory settings with static images displayed. And statistical parameters computed from recordings of saccades and fixations were compared. A step forward measuring visual impairments in a naturalistic situation consists in using everyday visual content such as colour video content for patients screening. The lack of curiosity hence can be induced from gaze recordings of intentionally degraded natural video content. The baseline model of automatic prediction of attention for normal control subjects was developed in [67, 68]. Contrarily to [69] where the first step to make the observation “natural” was done by using video in free viewing conditions, in [68, 69] video was intentionally degraded.

While studying visual deficits on laboratory tasks has been productive for AD assessment, its application requires cooperative scenarios. That is, subjects must cooperate consciously performing the oculomotor tasks to get their assessment. Thus, this type of assessment is adequate when there is already an evident manifestation of dementia that requires evaluation. In addition, the manifestation cannot be severe enough so the subject is not able to cooperate. To achieve early diagnosis, it is necessary to have techniques that allow the evaluation of eye movements abnormalities on scenarios that allow naturalistic assessment without the explicit cooperation from subjects, for example, to analyze how AD affects eye movements in ADL, such as cooking or gardening. In the following section we describe the work related to analysis of eye movements in naturalistic scenarios.

3.3. Eye Movements Analysis in Naturalistic Tasks

When performing daily activities such as cooking or gardening, subjects interact with several objects, for example knifes, pans, or remote controls. During these interactions, a succession of different actions is involved, for example, cutting a vegetable or watering a plant. While executing these actions, humans use their vision to locate the objects and to manipulate them [70]. Indeed, the eye movements during everyday tasks provide relevant information about complex cognitive process related to object identification, place memory, tasks execution, and monitoring [71].

Studies attempt to understand the relation between activity execution and eye movements by investigating the eye patterns and eye-hand coordination on actions [72, 73]. For example, results support that people shift their gaze to target sites anticipating actions [74]. Also, results indicate that subjects rarely fixate on objects irrelevant to a performed action [73]. In fact, almost all eye movements during activities are targeted to fixation of task relevant objects, suggesting that visual attention can be modelled as “top-down” having little influence of the “intrinsic saliency” of the scene [72]. Top-down modelling refers to aspects of attention and gaze that are under executive control and may be influenced by tasks’ directives and working memory [75]. Thus, top-down models require prior knowledge from the context [15]. On the other hand, bottom-up modelling refers to attention that is driven by properties of the visual stimulus being independent from tasks or semantic [75].

The described findings so far have arisen from experiments with healthy subjects. While the results are important to understand the eye movements in ADL, experiments with AD patients are scarce. This later is critical to support the diagnosis in early stages and to monitor changes of the disease. Healthy subjects have demonstrated different results when conducting specific oculomotor task when compared with PwAD and we expect the same in naturalistic scenarios.

In the work by Forde et al. [76] the eye movements in an ADL task are analyzed from a patient with action disorganization syndrome (ADS), from a PwAD, and from control subjects. The results show difference in the visual behavior from the participants while they were preparing a cup of tea. For example, the ADS patient made no glances to objects anticipating their use and had an increased number of fixations to irrelevant objects during the task. This shows different results from those stated in [73, 74]. The AD patient showed fewer fixations overall than control subjects and the ADS patients. In addition, the PwAD showed a lower proportion of relevant fixations compared to control subjects. In the work by Suzuki et al. [28] eye movement is investigated during locomotion. One AD patient, one Posterior Cortical Atrophy (PCA) patient, and one healthy subject used an eye tracking device while performing locomotion activities (walking along corridors, up and down stairs, and across a room with or without obstacles). The results show that the PCA patients were the slowest in performing the locomotion activities. Also, the PCA patient had longer fixation than the PwAD and the healthy subject. The PwAD required prompting during task competition showing memory impairment. Both studies show important findings toward understanding eye movements from PwAD; however more experiments with more participants are required.

A research goal is to understand eye movements abnormalities when performing ADL that serve to identify early signs of AD and to alert about a possible development of the disease. However, several challenges must be addressed first. For example, despite finding differences between PwAD and control groups, several abnormalities on visual deficits are not unique to AD but they are also present in other pathologies. In addition, it is important to find a visual marker that can be used to measure the progression of the disease; that is, the longitudinal studies must be conducted. Additionally, the clinical and personal history of each patient must be considered. PwAD might have differences in their visual behavior due to their physiological and personal context. Such is the case, for example, if they have sensorial impairments or a determining event in their lives. For example, a manual worker might have a different behavior than a white-collar worker.

The analysis of visual behavior during ADL has the potential to become a tool for AD assessment and for monitoring progression. Its success strongly relies on the development of technology able to measure eye movements. To be a pervasive tool it has to measure eye movements easily and in a noninvasive way allowing subjects to perform their activities in a natural manner.

Currently, there are clinical trials registers describing ongoing research with the objective to analyze eye movements in naturalistic tasks. For example, by doing a search with the terms “Alzheimer’s disease” and “eye movements” in the database ClinicalTrials.gov provided by the US National Library of Medicine, there are 10 results currently recruiting participants. We identified 2 as relevant ongoing studies of eye movements in naturalistic scenarios for AD. In [77], researchers aim to analyze eye movements when reading sentences. In [78], researchers aim to analyze deficits in visual exploration in ADL.

Researchers in [78] expect to encounter that persons with AD have less ability of using scene semantic when locating objects. In this sense, the understanding of scene is paramount. In the next section we describe how the use of computational techniques can leverage the analysis of eye movements and AD by scene understanding.

4. Towards Early Detection Leveraging on Computational Attention Modelling

As we mentioned before, the identification of abnormalities in eye movements to support the early diagnosis or progression of an eventual dementia disease in elderly population during performance of ADL is a real scientific challenge. In this sense, some interesting approaches propose to predict human visual attention emulating the Human Visual Systems performance [79]. Indeed, computational visual attention models (CVSM) attempt to explain and describe the process of perceptual behavior and are compared with ground truth measured by eye trackers in psychovisual experiments [80–82]. Several exciting CVSM such as visual saliency techniques on egocentric video are useful for the use in naturalistic scenarios to estimate the areas from the video that are more likely to become the focus of human visual attention [15]. The egocentric video provides a first-person view from the individual who “wears” an egocentric camera giving visual information about objects, locations, and interactions.

Visual saliency techniques have been already combined with eye tracking in the field of Autism Spectrum Disorder (ASD) to screen differences between people with ASD and controls [83]. Researchers compare eye movements from both groups when freely viewing natural scenes images. In the analysis fixations towards visually salient regions, such as color, intensity, orientation, objects, and faces, are considered. To the best of our knowledge, research regarding the combination of data from eye trackers and visual saliency modeling to analyze eye movements abnormalities from PwAD is scarce. As we show earlier in Section 3.2 the work in [67] approaches with the analysis of fixations to degraded images, but more research is missing.

Suitable devices identified to be appropriated for monitoring ADLs with egocentric vision capabilities are mobile eye trackers [20], such as Tobbi© or SMI©. Additionally, egocentric cameras such as GoPro, Samsung Glass, and Microsoft Sense Cam [84] would allow scene understanding. Certainly, they record egocentric video giving a first-person view or in other words, what the camera wearer sees [85]. This captured information can be useful to analyze or predict some or all of visual attentive behavior through visual saliency computation. In this section, the main characteristics from the research on visual saliency are described, the techniques used and how this research field can be applied in the context of eye movements analysis.

(1) Computational Visual Saliency Models. The research field that analyzes video computationally to estimate the image regions that attract visual attention is called visual saliency detection [86, 87]. This research field matches the areas of neuroscience, psychology, and computer vision [16].

Early work on visual saliency modelling uses handcrafted low-level features such as contrast [88], color [89], edges [90], and orientation. It is funded on feature integration theory by Treisman and Gelade [91]. In addition, there is work that performs higher-level features extraction such as objects [92] and faces [93] in order to incorporate, into the low-level features, semantic elements of the observed scenes. Moreover, since the boom of deep learning, there are different proposals of configuration and arrangements of these supervised classification tools such as the convolutional neural networks [94–96] that report increased results for saliency estimation tasks. However, as deep learning requires a huge amount of data, more annotated information on diverse scenarios is still required. The works in [15, 97, 98] review techniques used for visual saliency detection.

According to the method used for modeling attention, there are two main categories of methods followed in the research of visual saliency: bottom-up modelling and top-down modelling. Bottom-up methods use information such as color, contrast, orientation, and texture [99]; they predict stimuli driven attention. And top-down models require prior knowledge on the visual search task and the context [15]. Currently, most of the work in visual saliency enters in the category of bottom-up methods.

The visual saliency modelling outputs a saliency map S, which is a two-dimensional topographically arranged map that encodes stimulus conspicuity of the visual scene [100]. The pixel values in the map indicate the saliency degree of the corresponding regions in the visual scene [15]. The maps are compared against ground truth maps built upon gaze fixations recorded by eye trackers when subjects are performing visual tasks. The ground truth might include synthetic stimuli or come from natural scenes including still images and video [101].

Pioneer research on visual saliency studied saliency from a third-person perspective, for instance, using still images [102] or video [103] coming from nonegocentric cameras. In the scenario of understanding scene for AD studies, the interest is nevertheless in saliency from the point of view of the subject performing activities. Hence, building saliency maps in egocentric video content and from the point of view of the subjects wearing recording device is required. However, the analysis of egocentric video brings new challenges. For instance, motion cues are significant in third-person video but camera motion is inherent to egocentric recordings [104]. Therefore, a residual motion in image plane of egocentric video has to be computed after motion of camera wearer has been compensated [105]. Egocentric video allows better introducing contextual knowledge from the subject because egocentric video follows the field of view of the subject’s action. In this sense, this paradigm can support top-down attention modeling [106] in naturalistic scenarios such as in ADLs execution.

Egocentric video, beside the bottom-up image cues, provides context about the manipulation of objects [107, 108], about hands positions [106, 109], ego-motion [110], actions [111, 112], and activities [113, 114]. The egocentric video supports top-down attention modelling by the ensemble of these diverse contextual information. For example, a model assumes that gaze goes towards a given object currently held by the subject’s hands. In addition, the ego-motion that occurs in visual exploration towards locating a specific object that is required in a given activity also serves for gaze estimation [115].

Top-down and bottom-up computational visual attention modelling show correlation between human fixations and predicted saliency maps. However, most of the results arise from experiments including healthy participants while scarce studies involve PwAD. In this review, we focus on the scenario for early AD detection. Thus, we address the relevant work relating computational attention modelling applied to AD in the next section.

(2) Computational Visual Saliency Models and Diagnosis. Progress in prediction of visual saliency including in egocentric content makes it possible to build robust prediction models for regions of high expectancy for the fixations of the test subject. Therefore, if a subject executing an ADL does not fixate the predicted areas properly, then it can be supposed that this subject has to undergo further tests to diagnose AD or not. For healthy subjects, visual saliency techniques assume that the subject will execute the activity fixating toward relevant objects or with coherent visual exploration. However, as mentioned in the work by Forde et al. [76], the participant with AD had lower proportion of relevant fixations compared to healthy subjects in ADL settings.

Another relevant feature about gaze measuring in patients with AD is the sensitivity. For example, the diagnosis performed with SEM tasks requires saccadic sensitivity. However, current visual saliency techniques addressing saccadic estimation are in early stages [116].

Although top-down mechanisms dominate the attention modelling from healthy subjects, it has been suggested that the visual behavior from persons with cognitive problems might rely on bottom-up mechanisms and saliency driven with less fixations on objects relevant to the task [71]. The work in [117] suggests that visual attention problems from AD patients are more notorious when the target item is not salient and shares common features with the background. The study in [118] analyzes the visual search task performance from AD patients by conducting experiments using salient and not salient search conditions. The researchers measure the reaction times when PwAD and control participants search for target elements. The PwAD show longer reaction times than control participants. However, the gap between both groups is bigger when searching for nonsalient target items. This suggests that salient elements attract PwAD.

The research in [105] on egocentric video acknowledges the potential to use visual saliency techniques to develop a tool for medical practitioners in realistic ADL scenarios. The researchers perform gaze comparison from an actor and a viewer. The actor is a person performing an activity (potentially a PwAD) while the viewer is a person watching egocentric video recordings from the actor (the medical practitioner). The paper suggests a relation between the gaze from the actor and the viewer. This relation consists in a time shift between the points of attention from the actor and the viewer. In other words, the viewer looks at the same place in the visual scene compared to the (healthy) actor but a few milliseconds later. The potential of this tool relies on the ability of a system to determine if the gaze from the actor is normal or abnormal according to the perspective from a medical practitioner. Additionally, the settings from the tool, like the use of egocentric camera, allow the use of computational attention-modelling techniques.

Computational attention-modelling techniques can be complemented with other contextual information in order to know more about the subject oculomotor behavior. For example, the amount of time that a participant takes to complete an activity can be explored. As literature shows, people with cognitive deficits take longer to complete tasks.

5. Conclusions and Future Directions

Neurodegenerative diseases, specifically Alzheimer’s disease, are a problem that affects population worldwide. Currently, AD has no cure, but it has been demonstrated that treatment is helpful to delay the progression and improve quality of life. The diagnosis occurs frequently at late stages of the disease, when symptoms are evident. Nevertheless, research has found that AD is present up to 20 years before the disease is manifested. To have better treatment outcomes, it is desirable to have an early diagnosis. Understanding contextual differences that might influence the course of the disease would also be helpful. Among the current diagnostic techniques, visual behavior has the potential to become useful in early stages and to be a pervasive tool. Several investigations have explored the relations of eye movements with AD through specific oculomotor tasks demonstrating visual features that can be used for early diagnosis and progression measurement. However, more experiments are necessary under naturalistic scenarios to develop a useful tool that can be used in early stages. Nevertheless, changes happening in older individuals without cognitive impairment must also be taken into consideration and eventually they have to be approached by means of further research in normal individuals. Eye movements abnormalities have been measured mostly using eye tracking technology. Nevertheless, computer vision techniques, such as visual saliency and object detections in ADL performance settings, could be a good means to measure visual attention of PwAD to diagnose in terms of its difference to normal control attention in naturalistic scenarios when performing ADLs. Several challenges must be addressed, such as estimating gaze on top-down driven mechanisms and relating bottom-up mechanisms with the activities. Also, it is important to conduct experiments with persons with different cognitive problems in order to learn the features that differentiate among healthy subjects, people with different diseases, and persons with AD.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This review was supported by the projects CATEDRAS CONACYT numbers 672 and IPN-SIP2018.

References

G. Díaz, E. Romero, J. A. Hernández-Tamames, V. Molina, and N. Malpica, “Automatic classification of structural MRI for diagnosis of neurodegenerative diseases,” Acta Biologica Colombiana, vol. 15, no. 3, pp. 165–180, 2010.
View at: Google Scholar
J. Koikkalainen, H. Rhodius-Meester, A. Tolonen et al., “Differential diagnosis of neurodegenerative diseases using structural MRI data,” NeuroImage: Clinical, vol. 11, pp. 435–449, 2016.
View at: Publisher Site | Google Scholar
A. J. Stoessl, “Neuroimaging in the early diagnosis of neurodegenerative disease,” Translational Neurodegeneration, vol. 1, article no. 5, 2012.
View at: Publisher Site | Google Scholar
A. Association, “2018 Alzheimers disease facts and figures,” Alzheimer’s & Dementia, vol. 14, no. 3, pp. 367–429, 2018.
View at: Publisher Site | Google Scholar
J. Dauwels and S. Kannan, “Diagnosis of alzheimer's disease using electric signals of the brain—a grand challenge,” Asia-Pacific Biotech News, vol. 16, no. 10n11, pp. 22–38, 2012.
View at: Publisher Site | Google Scholar
A. Nordberg, J. O. Rinne, A. Kadir, and B. Långström, “The use of PET in Alzheimer disease,” Nature Reviews Neurology, vol. 6, no. 2, pp. 78–87, 2010.
View at: Publisher Site | Google Scholar
W. V. Graham, A. Bonito-Oliva, and T. P. Sakmar, “Update on alzheimer's disease therapy and prevention strategies,” Annual Review of Medicine, vol. 68, no. 1, pp. 413–430, 2017.
View at: Publisher Site | Google Scholar
M. E. De Vugt and F. R. J. Verhey, “The impact of early dementia diagnosis and intervention on informal caregivers,” Progress in Neurobiology, vol. 110, pp. 54–62, 2013.
View at: Publisher Site | Google Scholar
K. Pietrzak, K. Czarnecka, E. Mikiciuk-Olasik, and P. Szymanski, “New Perspectives of Alzheimer Disease Diagnosis – the Most Popular and Future Methods,” Medicinal Chemistry, 2017.
View at: Google Scholar
J. Weuve, C. Proust-Lima, M. C. Power et al., “Guidelines for reporting methodological challenges and evaluating potential bias in dementia research,” Alzheimer’s & Dementia, vol. 11, no. 9, article no. 2048, pp. 1098–1109, 2015.
View at: Publisher Site | Google Scholar
G. Fernández, F. Manes, L. E. Politi et al., “Patients with Mild Alzheimer's Disease Fail When Using Their Working Memory: Evidence from the Eye Tracking Technique,” Journal of Alzheimer's Disease, vol. 50, no. 3, pp. 827–838, 2016.
View at: Publisher Site | Google Scholar
M. Boucart, G. Bubbico, S. Szaffarczyk, and F. Pasquier, “Animal spotting in Alzheimer's disease: An eye tracking study of object categorization,” Journal of Alzheimer's Disease, vol. 39, no. 1, pp. 181–189, 2014.
View at: Publisher Site | Google Scholar
A. König, G. Sacco, G. Bensadoun et al., “The role of information and communication technologies in clinical trials with patients with Alzheimer's disease and related disorders,” Frontiers in Aging Neuroscience, vol. 7, p. 110, 2015.
View at: Publisher Site | Google Scholar
R. J. Molitor, P. C. Ko, and B. A. Ally, “Eye movements in alzheimers disease,” Journal of Alzheimers Disease, vol. 44, no. 1, pp. 1–12, 2015.
View at: Google Scholar
M. Runxin, Y. Yu, and X. Yue, “Survey on Image Saliency Detection Methods,” in Proceedings of the 7th International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery, CyberC 2015, pp. 329–338, September 2015.
View at: Publisher Site | Google Scholar
L. Huo, L. Jiao, S. Wang, and S. Yang, “Object-level saliency detection with color attributes,” Pattern Recognition, vol. 49, pp. 162–173, 2016.
View at: Publisher Site | Google Scholar
P. K. Muthumanickam, C. Forsell, K. Vrotsou, J. Johansson, and M. Cooper, “Supporting exploration of eye tracking data: Identifying changing behaviour over long durations,” in Proceedings of the 6th Workshop Beyond Time and Errors on Novel Evaluation Methods for Visualization, BELIV 2016, pp. 70–77.
View at: Publisher Site | Google Scholar
V. Pallarés, M. Hernández, and L. Dempere-Marco, “Eye-Tracking Data in Visual Search Tasks: A, Hallmark of Cognitive Function,” Biosystems and Biorobotics, vol. 15, pp. 873–877, 2017.
View at: Publisher Site | Google Scholar
T. J. Crawford, A. Devereaux, S. Higham, and C. Kelly, “The disengagement of visual attention in Alzheimer's disease: A longitudinal eye-tracking study,” Frontiers in Aging Neuroscience, vol. 7, article no. 118, 2015.
View at: Publisher Site | Google Scholar
L. Itti, “New Eye-Tracking Techniques May Revolutionize Mental Health Screening,” Neuron, vol. 88, no. 3, pp. 442–444, 2015.
View at: Publisher Site | Google Scholar
K. Holmqvist, M. Nyström, R. Andersson et al., Eye tracking: A comprehensive guide to methods and measures, OUP Oxford, 2011.
I. M. Pavisic, N. C. Firth, S. Parsons et al., “Eyetracking metrics in young onset alzheimer's disease: a window into cognitive visual functions,” Frontiers in Neurology, vol. 8, article 377, 2017.
View at: Google Scholar
G. Fernández, L. R. Castro, M. Schumacher, and O. E. Agamennoni, “Diagnosis of mild Alzheimer disease through the analysis of eye movements during reading,” Journal of integrative neuroscience, vol. 14, no. 1, pp. 121–133, 2015.
View at: Publisher Site | Google Scholar
D. C. Niehorster, T. H. W. Cornelissen, K. Holmqvist, I. T. C. Hooge, and R. S. Hessels, “What to expect from your remote eye-tracker when participants are unrestrained,” Behavior Research Methods, pp. 1–15, 2017.
View at: Publisher Site | Google Scholar
V. Vallejo, D. Cazzoli, L. Rampa et al., “Effects of Alzheimer's disease on visual target detection: A "peripheral bias",” Frontiers in Aging Neuroscience, vol. 8, article no. 200, 2016.
View at: Publisher Site | Google Scholar
K. M. Galetta, K. R. Chapman, M. D. Essis et al., “Screening Utility of the King-Devick Test in Mild Cognitive Impairment and Alzheimer Disease Dementia,” Alzheimer Disease & Associated Disorders, vol. 31, no. 2, pp. 152–158, 2017.
View at: Publisher Site | Google Scholar
S. A. Chau, J. Chung, N. Herrmann, M. Eizenman, and K. L. Lanctôt, “Apathy and Attentional Biases in Alzheimer's Disease,” Journal of Alzheimer's Disease, vol. 51, no. 3, pp. 837–846, 2016.
View at: Publisher Site | Google Scholar
T. Suzuki, K. Yong, B. Yang et al., “Locomotion and eye behaviour under controlled environment in individuals with Alzheimer's disease,” in Proceedings of the 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015, pp. 6594–6597, August 2015.
View at: Publisher Site | Google Scholar
G. Fernández, M. Schumacher, L. Castro, D. Orozco, and O. Agamennoni, “Patients with mild Alzheimer's disease produced shorter outgoing saccades when reading sentences,” Psychiatry Research, vol. 229, no. 1-2, pp. 470–478, 2015.
View at: Publisher Site | Google Scholar
Q. Lenoble, G. Bubbico, S. Szaffarczyk, F. Pasquier, and M. Boucart, “Scene categorization in Alzheimer's disease: A saccadic choice task,” Dementia and Geriatric Cognitive Disorders Extra, vol. 5, no. 1, pp. 1–12, 2015.
View at: Publisher Site | Google Scholar
G. Fernández, F. Manes, N. P. Rotstein et al., “Lack of contextual-word predictability during reading in patients with mild Alzheimer disease,” Neuropsychologia, vol. 62, no. 1, pp. 143–151, 2014.
View at: Publisher Site | Google Scholar
G. Fernández, J. Laubrock, P. Mandolesi, O. Colombo, and O. Agamennoni, “Registering eye movements during reading in Alzheimers disease: Difficulties in predicting upcoming words,” Journal of Clinical and Experimental Neuropsychology, vol. 36, no. 3, pp. 302–316, 2014.
View at: Publisher Site | Google Scholar
G. Fernández, P. Mandolesi, N. P. Rotstein, O. Colombo, O. Agamennoni, and L. E. Politi, “Eye movement alterations during reading in patients with early Alzheimer disease.,” Investigative ophthalmology & visual science, vol. 54, no. 13, pp. 8345–8352, 2013.
View at: Publisher Site | Google Scholar
Z. Kapoula, Q. Yang, J. Otero-Millan et al., “Distinctive features of microsaccades in Alzheimer's disease and in mild cognitive impairment,” AGE, vol. 36, no. 2, pp. 535–543, 2014.
View at: Publisher Site | Google Scholar
H. W. Heuer, J. B. Mirsky, E. L. Kong et al., “Antisaccade task reflects cortical involvement in mild cognitive impairment,” Neurology, vol. 81, no. 14, pp. 1235–1243, 2013.
View at: Publisher Site | Google Scholar
T. J. Crawford, S. Higham, J. Mayes, M. Dale, S. Shaunak, and G. Lekwuwa, “The role of working memory and attentional disengagement on inhibitory control: Effects of aging and Alzheimer's disease,” AGE, vol. 35, no. 5, pp. 1637–1650, 2013.
View at: Publisher Site | Google Scholar
Q. Yang, T. Wang, N. Su, S. Xiao, and Z. Kapoula, “Specific saccade deficits in patients with Alzheimer's disease at mild to moderate stage and in patients with amnestic mild cognitive impairment,” AGE, vol. 35, no. 4, pp. 1287–1298, 2013.
View at: Publisher Site | Google Scholar
A. C. McKee, R. Au, H. J. Cabral et al., “Visual association pathology in preclinical Alzheimer disease,” Journal of Neuropathology & Experimental Neurology, vol. 65, no. 6, pp. 621–630, 2006.
View at: Publisher Site | Google Scholar
A. A. Brewer and B. Barton, “Visual cortex in aging and Alzheimer's disease: Changes in visual field maps and population receptive fields,” Frontiers in Psychology, vol. 5, Article ID Article 74, 2014.
View at: Publisher Site | Google Scholar
Y. Kusne, A. B. Wolf, K. Townley, M. Conway, and G. A. Peyman, “Visual system manifestations of Alzheimer's disease,” Acta Ophthalmologica, 2016.
View at: Google Scholar
J. K. H. Lim, Q.-X. Li, Z. He et al., “The eye as a biomarker for Alzheimer's disease,” Frontiers in Neuroscience, vol. 10, article no. 536, 2016.
View at: Publisher Site | Google Scholar
R. A. Armstrong, “Alzheimer's disease and the eye,” Journal of Optometry, vol. 2, no. 3, pp. 103–111, 2009.
View at: Publisher Site | Google Scholar
F. Z. Javaid, J. Brenton, L. Guo, and M. F. Cordeiro, “Visual and ocular manifestations of Alzheimer's disease and their use as biomarkers for diagnosis and progression,” Frontiers in Neurology, vol. 7, article no. 55, 2016.
View at: Publisher Site | Google Scholar
M. R. MacAskill and T. J. Anderson, “Eye movements in neurodegenerative diseases,” Current Opinion in Neurology, vol. 29, no. 1, pp. 61–68, 2016.
View at: Publisher Site | Google Scholar
R. Tzekov and M. Mullan, “Vision function abnormalities in Alzheimer disease,” Survey of Ophthalmology, vol. 59, no. 4, pp. 414–433, 2014.
View at: Publisher Site | Google Scholar
U. Rüb, K. Del Tredici, C. Schultz, J. A. Büttner-Ennever, and H. Braak, “The premotor region essential for rapid vertical eye movements shows early involvement in Alzheimer's disease-related cytoskeletal pathology,” Vision Research, vol. 41, no. 16, pp. 2149–2156, 2001.
View at: Publisher Site | Google Scholar
A. L. Boxer, S. Garbutt, W. W. Seeley et al., “Saccade abnormalities in autopsy-confirmed frontotemporal lobar degeneration and alzheimer disease,” JAMA Neurology, vol. 69, no. 4, pp. 509–517, 2012.
View at: Publisher Site | Google Scholar
M. L. G. Freitas Pereira, M. von Zuben A Camargo, I. Aprahamian, and O. V. Forlenza, “Eye movement analysis and cognitive processing: Detecting indicators of conversion to Alzheimer's disease,” Neuropsychiatric Disease and Treatment, vol. 10, pp. 1273–1285, 2014.
View at: Publisher Site | Google Scholar
T. A. Amor, S. D. S. Reis, D. Campos, H. J. Herrmann, and J. S. Andrade, “Persistence in eye movement during visual search,” Scientific Reports, vol. 6, Article ID 20815, 2016.
View at: Publisher Site | Google Scholar
O. A. Coubard, “What do we know about eye movements in Alzheimer's disease? The past 37 years and future directions,” Biomarkers in Medicine, vol. 10, no. 7, pp. 677–680, 2016.
View at: Publisher Site | Google Scholar
T. J. Crawford and S. Higham, “Distinguishing between impairments of working memory and inhibitory control in cases of early dementia,” Neuropsychologia, vol. 81, pp. 61–67, 2016.
View at: Publisher Site | Google Scholar
Q. Yang, T. Wang, N. Su, Y. Liu, S. Xiao, and Z. Kapoula, “Long Latency and High Variability in Accuracy-Speed of Prosaccades in Alzheimer’s Disease at Mild to Moderate Stage,” Dementia and Geriatric Cognitive Disorders Extra, vol. 1, no. 1, pp. 318–329, 2011.
View at: Publisher Site | Google Scholar
S. Garbutt, A. Matlin, J. Hellmuth et al., “Oculomotor function in frontotemporal lobar degeneration, related disorders and Alzheimer's disease,” Brain, vol. 131, no. 5, pp. 1268–1281, 2008.
View at: Publisher Site | Google Scholar
L. D. Kaufman, J. Pratt, B. Levine, and S. E. Black, “Antisaccades: A probe into the dorsolateral prefrontal cortex in Alzheimer's disease. A critical review,” Journal of Alzheimer's Disease, vol. 19, no. 3, pp. 781–793, 2010.
View at: Publisher Site | Google Scholar
A. Peltsch, A. Hemraj, A. Garcia, and D. P. Munoz, “Saccade deficits in amnestic mild cognitive impairment resemble mild Alzheimer's disease,” European Journal of Neuroscience, vol. 39, no. 11, pp. 2000–2013, 2014.
View at: Publisher Site | Google Scholar
L. D. Kaufman, J. Pratt, B. Levine, and S. E. Black, “Executive deficits detected in mild Alzheimer's disease using the antisaccade task,” Brain and Behavior, vol. 2, no. 1, pp. 15–21, 2012.
View at: Publisher Site | Google Scholar
S. H. Brooks, E. M. Klier, S. D. Red et al., “Slowed prosaccades and increased antisaccade errors as a potential behavioral biomarker of multiple system atrophy,” Frontiers in Neurology, vol. 8, article no. 261, 2017.
View at: Publisher Site | Google Scholar
N. Noiret, N. Carvalho, É. Laurent et al., “Saccadic Eye Movements and Attentional Control in Alzheimer's Disease,” Archives of Clinical Neuropsychology, vol. 33, no. 1, pp. 1–13, 2018.
View at: Publisher Site | Google Scholar
A. C. Bowling, P. Lindsay, B. G. Smith, and K. Storok, “Saccadic eye movements as indicators of cognitive function in older adults,” Aging, Neuropsychology, and Cognition, vol. 22, no. 2, pp. 201–219, 2015.
View at: Publisher Site | Google Scholar
H. Amieva, H. Mokri, M. Le Goff et al., “Compensatory mechanisms in higher-educated subjects with Alzheimer's disease: A study of 20 years of cognitive decline,” Brain, vol. 137, no. 4, pp. 1167–1175, 2014.
View at: Publisher Site | Google Scholar
F. W. Bylsma, D. X. Rasmusson, G. W. Rebok, P. M. Keyl, L. Tune, and J. Brandt, “Changes in visual fixation and saccadic eye movements in Alzheimer's disease,” International Journal of Psychophysiology, vol. 19, no. 1, pp. 33–40, 1995.
View at: Publisher Site | Google Scholar
L. A. Hershey, L. Whicker, L. A. Abel, L. F. Dell'osso, S. Traccis, and D. Grossniklaus, “Saccadic Latency Measurements in Dementia,” JAMA Neurology, vol. 40, no. 9, pp. 592-593, 1983.
View at: Publisher Site | Google Scholar
W. A. Fletcher and J. A. Sharpe, “Saccadic eye movement dysfunction in Alzheimer's disease,” Annals of Neurology, vol. 20, no. 4, pp. 464–471, 1986.
View at: Publisher Site | Google Scholar
F. J. Pirozzolo and E. C. Hansch, “Oculomotor reaction time in dementia reflects degree of cerebral dysfunction,” Science, vol. 214, no. 4518, pp. 349–351, 1981.
View at: Publisher Site | Google Scholar
S. A. Chau, N. Herrmann, C. Sherman et al., “Visual Selective Attention Toward Novel Stimuli Predicts Cognitive Decline in Alzheimer's Disease Patients,” Journal of Alzheimer's Disease, vol. 55, no. 4, pp. 1–11, 2017.
View at: Publisher Site | Google Scholar
Y. Zhang, T. Wilcockson, K. I. Kim, T. Crawford, H. Gellersen, and P. Sawyer, “Monitoring dementia with automatic eye movements analysis,” Smart Innovation, Systems and Technologies, vol. 57, pp. 299–309, 2016.
View at: Publisher Site | Google Scholar
S. Chaabouni, J. Benois-pineau, F. Tison, C. Ben Amar, and A. Zemmari, “Prediction of visual attention with deep CNN on artificially degraded videos for studies of attention of patients with Dementia,” Multimedia Tools and Applications, vol. 76, no. 21, pp. 1–20, 2017.
View at: Publisher Site | Google Scholar
S. Chaabouni, F. Tison, J. Benois-Pineau, and C. Ben Amar, “Prediction of visual attention with Deep CNN for studies of neurodegenerative diseases,” in Proceedings of the 14th International Workshop on Content-Based Multimedia Indexing, CBMI 2016, pp. 1–6, June 2016.
View at: Publisher Site | Google Scholar
P.-H. Tseng, I. G. M. Cameron, G. Pari, J. N. Reynolds, D. P. Munoz, and L. Itti, “High-throughput classification of clinical populations from natural viewing eye movements,” Journal of Neurology, vol. 260, no. 1, pp. 275–284, 2013.
View at: Publisher Site | Google Scholar
M. Land, N. Mennie, and J. Rusted, “The roles of vision and eye movements in the control of activities of daily living,” Perception, vol. 28, no. 11, pp. 1311–1328, 1999.
View at: Publisher Site | Google Scholar
S. C. Seligman and T. Giovannetti, “The Potential Utility of Eye Movements in the Detection and Characterization of Everyday Functional Difficulties in Mild Cognitive Impairment,” Neuropsychology Review, vol. 25, no. 2, pp. 199–215, 2015.
View at: Publisher Site | Google Scholar
M. F. Land and M. Hayhoe, “In what ways do eye movements contribute to everyday activities?” Vision Research, vol. 41, no. 25-26, pp. 3559–3565, 2001.
View at: Publisher Site | Google Scholar
M. F. Land, “Eye movements and the control of actions in everyday life,” Progress in Retinal and Eye Research, vol. 25, no. 3, pp. 296–324, 2006.
View at: Publisher Site | Google Scholar
F. Donnarumma, M. Costantini, E. Ambrosini, K. Friston, and G. Pezzulo, “Action perception as hypothesis testing,” Cortex, vol. 89, pp. 45–60, 2017.
View at: Publisher Site | Google Scholar
J. F. G. Boisvert and N. D. B. Bruce, “Predicting task from eye movements: On the importance of spatial distribution, dynamics, and image features,” Neurocomputing, vol. 207, pp. 653–668, 2016.
View at: Publisher Site | Google Scholar
E. M. E. Forde, J. Rusted, N. Mennie, M. Land, and G. W. Humphreys, “The eyes have it: An exploration of eye movements in action disorganisation syndrome,” Neuropsychologia, vol. 48, no. 7, pp. 1895–1900, 2010.
View at: Publisher Site | Google Scholar
ClinicalTrials.gov [Internet], National Library of Medicine (US), Centre Hospitalier Universitaire de Nice, Identifier NCT02557464, “Identification of early markers of alzheimer’s disease by using eye tracking in reading. (adal),” 2015, this study is currently recruiting participants. Available: https://clinicaltrials.gov/ct2/show/NCT02557464?term=eye&cond=Alzheimer+Disease&cntry=FR&rank=1.
ClinicalTrials.gov [Internet], National Library of Medicine (US), Centre Hospitalier Universitaire de Nice, Identifier NCT02941289 , “Visuospatial attention, eye movements and instrumental activities of daily living (iadls) in alzheimer’s disease (arva-ma),” 2016, this study is currently recruiting participants. Available: https://clinicaltrials.gov/ct2/show/NCT02941289?term=Eye+movements&recrs=ab&cond=Alzheimer+Disease&rank=1.
M. Mancas, V. P. Ferrera, N. Riche, and J. G. Taylor, From Human Attention to Computational Attention: A Multidisciplinary Approach, vol. 10, Springer, 2016.
S. Frintrop, “Computational visual attention,” in Computer Analysis of Human Behavior, pp. 69–101, Springer, 2011.
View at: Google Scholar
L. Itti and C. Koch, “Computational modelling of visual attention,” Nature Reviews Neuroscience, vol. 2, no. 3, pp. 194–203, 2001.
View at: Publisher Site | Google Scholar
J. K. Tsotsos and A. Rothenstein, “Computational models of visual attention,” Scholarpedia, vol. 6, no. 1, article 6201, 2011.
View at: Publisher Site | Google Scholar
S. Wang, M. Jiang, X. M. Duchesne et al., “Atypical Visual Saliency in Autism Spectrum Disorder Quantified through Model-Based Eye Tracking,” Neuron, vol. 88, no. 3, pp. 604–616, 2015.
View at: Publisher Site | Google Scholar
S. Singh, C. Arora, and C. V. Jawahar, “First person action recognition using deep learned descriptors,” in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, pp. 2620–2628, July 2016.
View at: Google Scholar
A. Betancourt, P. Morerio, C. S. Regazzoni, and M. Rauterberg, “The evolution of first person vision methods: A survey,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 25, no. 5, pp. 744–760, 2015.
View at: Publisher Site | Google Scholar
J. Pan, C. Canton-Ferrer, K. McGuinness et al., “Salgan: Visual saliency prediction with generative adversarial networks,” CoRR, https://arxiv.org/abs/1701.01081v2.
View at: Google Scholar
M. Cornia, L. Baraldi, G. Serra, and R. Cucchiara, “Predicting human eye fixations via an lstm-based saliency attentive model,” CoRR, https://arxiv.org/abs/1611.09571v3.
View at: Google Scholar
P. Reinagel and A. M. Zador, “Natural scene statistics at the centre of gaze,” Network: Computation in Neural Systems, vol. 10, no. 1-10, article 4, 1999.
View at: Publisher Site | Google Scholar
T. Jost, N. Ouerhani, R. V. Wartburg, R. Müri, and H. Hügli, “Assessing the contribution of color in visual attention,” Computer Vision and Image Understanding, vol. 100, no. 1-2, pp. 107–123, 2005.
View at: Publisher Site | Google Scholar
R. J. Baddeley and B. W. Tatler, “High frequency edges (but not contrast) predict where we fixate: A Bayesian system identification analysis,” Vision Research, vol. 46, no. 18, pp. 2824–2833, 2006.
View at: Publisher Site | Google Scholar
A. M. Treisman and G. Gelade, “A feature-integration theory of attention,” Cognitive Psychology, vol. 12, no. 1, pp. 97–136, 1980.
View at: Publisher Site | Google Scholar
A. Borji, M. Cheng, H. Jiang, and J. Li, “Salient object detection: a survey,” CoRR, https://arxiv.org/abs/1411.5878.
View at: Google Scholar
M. Cerf, E. P. Frady, and C. Koch, “Faces and text attract gaze independent of the task: Experimental data and computer model,” Journal of vision, vol. 9, no. 12, pp. 10–10, 2009.
View at: Google Scholar
S. S. S. Kruthiventi, V. Gudisa, J. H. Dholakiya, and R. V. Babu, “Saliency unified: A deep architecture for simultaneous eye fixation prediction and salient object segmentation,” in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, pp. 5781–5790, July 2016.
View at: Google Scholar
G. Li and Y. Yu, “Deep contrast learning for salient object detection,” in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, pp. 478–487, July 2016.
View at: Google Scholar
N. Liu and J. Han, “DHSNet: Deep hierarchical saliency network for salient object detection,” in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, pp. 678–686, July 2016.
View at: Google Scholar
Q. Zhao and C. Koch, “Learning saliency-based visual attention: A review,” Signal Processing, vol. 93, no. 6, pp. 1401–1407, 2013.
View at: Publisher Site | Google Scholar
A. Borji and L. Itti, “State-of-the-art in visual attention modeling,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 1, pp. 185–207, 2013.
View at: Publisher Site | Google Scholar
J. Kuen, Z. Wang, and G. Wang, “Recurrent attentional networks for saliency detection,” in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, pp. 3668–3677, July 2016.
View at: Google Scholar
R. Veale, Z. M. Hafed, and M. Yoshida, “How is visual salience computed in the brain? Insights from behaviour, neurobiology and modeling,” Philosophical Transactions of the Royal Society B: Biological Sciences, vol. 372, no. 1714, Article ID 20160113, 2017.
View at: Publisher Site | Google Scholar
A. Borji, D. N. Sihite, and L. Itti, “Quantitative analysis of human-model agreement in visual saliency modeling: a comparative study,” IEEE Transactions on Image Processing, vol. 22, no. 1, pp. 55–69, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
L. Duan, J. Gu, Z. Yang, J. Miao, W. Ma, and C. Wu, “Bio-inspired Visual Attention Model and Saliency Guided Object Segmentation,” in Genetic and Evolutionary Computing, vol. 238 of Advances in Intelligent Systems and Computing, pp. 291–298, Springer, 2014.
View at: Publisher Site | Google Scholar
W.-T. Li, H.-S. Chang, K.-C. Lien, H.-T. Chang, and Y.-C. F. Wang, “Exploring visual and motion saliency for automatic video object extraction,” IEEE Transactions on Image Processing, vol. 22, no. 7, pp. 2600–2610, 2013.
View at: Publisher Site | Google Scholar
Y.-C. Su and K. Grauman, “Detecting engagement in egocentric video,” in Proceedings of the European Conference on Computer Vision, pp. 454–471, Springer, 2016.
View at: Google Scholar
H. Boujut, V. Buso, J. Benois-Pineau et al., “Visual saliency maps for studies of behavior of patients with neurodegenerative diseases: Observer’s versus actor’s points of view,” in Innovation in Medicine & Healthcare, KES, 2013.
View at: Google Scholar
V. Buso, I. González-Díaz, and J. Benois-Pineau, “Goal-oriented top-down probabilistic visual attention model for recognition of manipulated objects in egocentric videos,” Signal Processing: Image Communication, vol. 39, pp. 418–431, 2015.
View at: Publisher Site | Google Scholar
A. Fathi, X. Ren, and J. M. Rehg, “Learning to recognize objects in egocentric activities,” in Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011, pp. 3281–3288, June 2011.
View at: Publisher Site | Google Scholar
X. Ren and M. Philipose, “Egocentric recognition of handled objects: Benchmark and analysis,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009, pp. 1–8, IEEE, 2009.
View at: Google Scholar
Y. Li, A. Fathi, and J. M. Rehg, “Learning to predict gaze in egocentric video,” in Proceedings of the 2013 14th IEEE International Conference on Computer Vision, ICCV 2013, pp. 3216–3223, December 2013.
View at: Publisher Site | Google Scholar
K. Matsuo, K. Yamada, S. Ueno, and S. Naito, “An attention-based activity recognition for egocentric video,” in Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2014, pp. 551–556, USA, June 2014.
View at: Publisher Site | Google Scholar
P. Le Bek, Learning to recognise actions in egocentric video, [MSc, thesis], University Glasgow, School of Computing Science, 2014.
S. Singh, C. Arora, and C. V. Jawahar, “Trajectory aligned features for first person action recognition,” Pattern Recognition, vol. 62, pp. 45–55, 2017.
View at: Publisher Site | Google Scholar
M. Ma, H. Fan, and K. M. Kitani, “Going deeper into first-person activity recognition,” in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, pp. 1894–1903, July 2016.
View at: Google Scholar
T.-H. Nguyen, J.-C. Nebel, and F. Florez-Revuelta, “Recognition of activities of daily living with egocentric vision: A review,” Sensors, vol. 16, no. 1, article no. 72, 2016.
View at: Publisher Site | Google Scholar
K. Yamada, Y. Sugano, T. Okabe et al., “Attention prediction in egocentric video using motion and visual saliency,” Advances in Image and Video Technology, pp. 277–288, 2012.
View at: Google Scholar
X. Sun, H. Yao, R. Ji, and X.-M. Liu, “Toward statistical modeling of saccadic eye-movement and visual saliency,” IEEE Transactions on Image Processing, vol. 23, no. 11, pp. 4649–4662, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
J. K. Foster, M. Behrmann, and D. T. Stuss, “Visual attention deficits in Alzheimer's disease: Simple versus conjoined feature search,” Neuropsychology, vol. 13, no. 2, pp. 223–245, 1999.
View at: Publisher Site | Google Scholar
A. Tales, J. Muir, R. Jones, A. Bayer, and R. J. Snowden, “The effects of saliency and task difficulty on visual search performance in ageing and Alzheimer's disease,” Neuropsychologia, vol. 42, no. 3, pp. 335–345, 2004.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2018 Jessica Beltrán et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

4235

Downloads

2331

Citations