Review Article

A Review of EEG and fMRI Measuring Aesthetic Processing in Visual User Experience Research

Table 5

Comprehensive summary of all current brain aesthetic processing research studies on UX and UI designs.

ReferencesVisual stimuli/contentUI/UX categoriesNumber of participantsBCI apparatusBCI paradigm, electrodes, and brain areaContributions to UI/UX

[44]Brain paintingUI and UX42 (questionnaire)Neurosky MindwaveActive BCI on FP1 positionThe research created brain painting and used the seven-chakra meditation concept. The mindfulness meditation UX and creative UI helped people decrease stress.
[100]Brain paintingUI and UX681 (questionnaire)Wireless g.NautilusP300 BCI with electrodes Fz, Cz, P3, Pz, P4, PO7, Oz, PO8Used P300 BCI and robotic machine to draw public art painting in a public area. It is a representative study of public art UX design.
[128]Brain paintingUX816 dry-electrode channels with the G Tec Nautilus EEG deviceP300 BCI with electrodes Cz, CPz, P1, P3, P5, P7, Pz, P2, P4, P6, P8, PO3, PO7, POz, PO6, and PO4The study helped people with amyotrophic lateral sclerosis experience brain painting through P300 BCI with VR installations.
[77]Color, shape, and animationUI37Monopolar 25-channel EEG with linked earlobes reference using an NVX-52 amplifierRSVP paradigm
P300-based BCI recorded in the O1, PO3, PO7, and T6 sites and the factor of color stimuli on O1, O2, PO3, and PO4. PO8 and POz sites were also affected
P300-based BCI works accurately with color stimuli and secondarily with shape stimuli.
[68]Color and environmentUX30US Neuroscan EEG recording and analysis system with 64-channel electrodesEvent-related spectral perturbation to observe the theta (4–7 Hz), alpha (8–13 Hz), beta (14–30 Hz), low gamma (31–50 Hz), and high gamma (51–100 Hz) bandsThe research considered the UX environment of the interior design inside a driven car. Men and women showed different brain high-gamma and high-beta feedback based on the color tone of the interiors.
[1]Dynamic and static landscapeUI and UX22fMRIBrain feedback on the regions of occipital lobe, frontal lobe, supplementary motor area, cingulate cortex, insula, middle temporal gyrus, and hippocampusThe research study demonstrated that dynamic visual stimuli were more visually pleasing than static visual stimuli by comparing and analyzing static and dynamic landscape stimuli.
[111]Emoji designUI10g.USBamp and g.EEGcapRSVP paradigm; gaze-independent BCI and event-related potential on the following electrodes: Cz, Pz, Oz, Fz, F3, F4, C3, C4, P3, P4, P7, P8, O1, and O2Participants evoked P300 and P400 amplitudes on colored dummy faces.
[129]Environment consideration of multisensory perceptionUX2464 electrodesFocus on alpha, beta, and gamma.
P100, N100, P200, N200, and P300 were selected
Details of the electrodes are described in the article
Research to help determine the combination of multisensory perceptions of UX.
[130]Environment considerationUX2064 silver (Ag/AgCl sintered) electrodes on a stretch Lycra Quik-CapEEG on alphaThe study compared personal aesthetic and affective responses towards paintings and public areas of commercial stimuli. It suggests the public UI and UX designs have a far-reaching influence on people’s decision-making.
[31]Environment considerationUX209Muse band (MoBI)AF7, AF8, TP9, TP10The research considered the environment on perceiving artwork, which can be used for future public interactive art such as TeamLab.
[71]Game interfaces and interactionsUI and UX---The paper summarizes the comprehensive EEG, ERP, and SSVEP brain analysis on game UI and UX designs.
[131]Icons (graph and text)UI25Australian Compumedics Neuroscan 64 EEG acquisition systemERP on N100 and P200 on Pz and CzThe research studied the icon design for the military field through ERP analysis.
[84]Images and wordsUI and UX2064 electrodesERP on N400 (FC1, FC2, FC3, FC4, FCz, C1, C2, C3, C4, Cz, CP1, CP2, CP3, CP4, CPz).
ERSP at FCz on time-frequency analysis
The research found that abstract images can be related to similar meanings of words. The research can persuade UX and UI designers to use artistic interaction in more abstract ways.
[108]Information visualizationUI and UX15g.GAMMAcapSpectral analysis on delta (<4 Hz), theta (4–8), alpha (8–12), beta (12–30), and gamma (30–60)Visual neuro-biofeedback of spatial visualization can help easily remember numbers and text.
[12]Mobile phone user experienceUX8Neuroscan system and 64 data channelsDelta, theta, gamma, beta, and alpha relative power of topographyThe study compared two smartphones with two different user experiences and found that better UX could have higher alpha, delta, and gamma but weaker beta and theta.
[69]Mobile phone shapeUX1823 Ag/AgCl electrodesOddball paradigm
N100 and N200 ERPs:
Frontal lobe (F3, FZ, F4)
Central sites (C3, CZ, C4)
Prefrontal (FP1, FPZ, FP2)
The study invented the research on using ERP to analyze the visual biofeedback from UX platforms, such as mobile phone shape.
[132]Navigation interface of mobile gameUI and UX22Neuroscan EEG system with 64 Ag/AgCl electrodesOddball paradigm
N100, P200, and N200 ERPs:
Prefrontal (FP1, FPz, FP2)
Frontal (F3, Fz, F4)
Frontal-central (FC3, FCz, FC4)
Central (C3, Cz, C4)
Used ERP to study the navigation of a game environment interface to develop UX on the game market.
[133]Product description design in online shoppingUI and UX1864 electrodes with a Neuroscan SynAmp 2 AmplifierObserve ERP feedback on P200, N200, and LPP (F1, Fz, F2, FC1, FCz, FC2, C1, Cz, C2, CP1, CPz, CP2, P1, Pz, and P2)The research utilized ERP to observe negative and positive frame designs on cognitive processing of evaluation biofeedback.
[134]Road animationUI and UX3Emotiv EPOCVisual and emotional response (frontal: AF3, AF4; temporal: T7, T8; parietal/occipital: Pz)
Topography
The research studied the driving environment comparing rural road city roads, which suits driving game designs or real driving UX research.
[135]Robotic danceUX---Although the study did not provide EEG analysis, it created a connection between neuroaesthetics and robotic dance for future brain analysis research. The study created a model of perceiving robotic dance stimuli with brain regions.
[136]Signs and textUI31Neuroscan SynAmp 2 Amplifier using 64 Ag/AgCl electrodesERP on N170, P200, N300, and N400
Frontal (F1, FZ, F2, FC1, FCZ, and FC2)
Central-partial area (CP3, CP4, and CPZ)
Parietal area (P3, PZ, P4)
The research studied the ERP visual biofeedback on signs and text in UI design.
[137]Spatial considerationUX5g.USBamp EEG system with g.SAHARA dry electrodesSteady-state visually evoked potential
Oz, O1, O2, POz, PO3, PO4, C1, and C2
The research studied spatial consideration on future UX or UI animation movements.
[138]Text designUI and UX35fMRIRapid serial visual presentationComprehensive research to study visual text memory through the ventral visual stream; the mid-fusiform cortex played a role in memorizing long-term visual word forms.
[139]Traffic interfaceUI36Emotiv + BCITest the mental work, stress, and emotions of reading information on multiple interfacesThe study can be used for future public transportation interface design.
[32]Time delay of interactionUX73fMRISet up three fMRI experiments to compare the results; observe the activated conditions in terms of anterior insular cortex, posterior medial frontal cortex, inferior parietal lobule, and inferior frontal junctionThe study analyzed the influence of delay on the UX in a human-computer interaction.
[140]User character icon designUI and UX24fMRIStudy activations of caudate nucleus, reward circuitry, dorsolateral prefrontal cortex, anterior cingulate cortex, dorsal anterior cingulate cortex, amygdala, etc.Observed brain region activation through fMRI. The results showed that men prefer online anthropomorphic avatar matching their ethnicity and women avoid interacting with the opposite gender.
[141]User evaluationUX8QUASAR DSI-24 dry-electrode EEG headsetEEG signals
Comparison of subjective evaluations and objective measurements
Tested visual and audio stimuli to compare EEG measurements and subjective evaluations.
[142]User interface designUI13Neuroscan EEG with 32 electrodesEEG topography
Theta (4–7 Hz), alpha (8–13 Hz), beta (14–30 Hz)
The study used the brain topography to compare two different UI design groups by observing theta, alpha, and beta band activation areas.
[143]User interface (browsing bar)UI-Eye tracker and EmotivCombined eye movement and EEG dataThe study combined both eye and brain data to optimize the UI design solutions.
[40]User interface design (mobile)UI964-channel elastic electrode capOddball paradigm
LPP and N200 were applied
Prefrontal (FP1, FPZ, FP2)
Frontal (F3, FZ, F4)
Central area (C3, CZ, C4)
The study tried to use EEG to analyze visual biofeedback of two different GUI designs.
[91]User experience concept designUX19BrainProduct actiChamp-32EEG topography
Delta (0.5–3.5 Hz)
Theta (4–7 Hz)
Alpha (8–12 Hz)
Beta (14–25 Hz)
Frontal left (FP1, FC9, F3, F7)
Frontal right (FC2, FC6)
Centrotemporal left (C3, T7)
Centrotemporal right (C4, T8)
Centroparietal left (CP1, CP5)
Centroparietal right (CP2, CP6)
Parietotemporal left (P3, P6)
Parietotemporal right (P4, P8)
Occipital left and right (O1, O2)
The research utilized EEG topography analysis to study open-ended, decision-making, and constrained design problems to improve design performance.
[144]Visual semantic memoryUX1532 channels using an electrode cap (Biosemi)PE (400–800 ms) and LPN (500–900 ms)
ERP electrodes on CP1, Cz, CP2, Pz
The study utilized the high and low visual semantics to explore the visual working memory.
[45]Visual interface memoryUI and UX12Emotiv EPOC+Test emotion feedback on visual memory performance through stressful or nonstressful environmentThe study is related to emotional response on liking of or wanting from the Chatterjee model. It covers data on interest, excitement, engagement, stress, relaxation, and focus.
The study also considered the environmental influence on visual memory performance, which helps future designers help people easily memorize visual content of UX and UI designs.
[47]Virtual game environmentUX-Combination of EEG with HTC ViveP300 BCIThe article summarizes P300 BCI’s current and future developments in connection with virtual reality games.
[26]WebsiteUI2032 sintered Ag/AgCl electrodesFrontal: F3, Fz, F4
Central: C3, Cz, C4
Parietal: P3, Pz, P4
Occipital: O1, Oz, O2
The research study compared the aesthetic processing between experts and laypersons on judging the beauty of websites.
[145]WebsiteUI16Neuroscan SynAmp 2 Amplifier with 24 Ag/AgCl electrodesP200, LPP, and N100 on ERP
Frontal (F3, F4)
Frontal-central group (FC3, FC4)
Central group (C3, C4)
Parietal group (P3, P4)
The research suits the Chatterjee model on the emotion stage on liking or wanting by perceiving early vision stimuli.
[146]Website logoUI20EEG recording caps for 32 channels (CP5, CP1, CP2, CP6, P7, P3, Pz, P4, P8, POz, O1, Oz, O2)P300 oddball paradigm on ERP analysisThe research defined three specific logo locations on the navigation bar and applied the ERP method to test the best design position of the website logo.

UI, user interface; UX, user experience; ERP, event-related potential; EEG, electroencephalograph; GUI, graphical user interface; fMRI, functional magnetic resonance imaging; BCI, brain-computer interface; VR, virtual reality; SSVEP, steady-state visually evoked potential; RSVP, rapid serial visual presentation.