Table of Contents Author Guidelines Submit a Manuscript
Computational and Mathematical Methods in Medicine
Volume 2013, Article ID 796183, 9 pages
http://dx.doi.org/10.1155/2013/796183
Review Article

Examining Similarity Structure: Multidimensional Scaling and Related Approaches in Neuroimaging

Department of Psychology, University of South Carolina, Columbia, SC 29208, USA

Received 6 December 2012; Accepted 19 March 2013

Academic Editor: Yuanqing Li

Copyright © 2013 Svetlana V. Shinkareva et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. A. J. O'Toole, F. Jiang, H. Abdi, N. Pénard, J. P. Dunlop, and M. A. Parent, “Theoretical, statistical, and practical perspectives on pattern-based classification approaches to the analysis of functional neuroimaging data,” Journal of Cognitive Neuroscience, vol. 19, no. 11, pp. 1735–1752, 2007. View at Publisher · View at Google Scholar · View at Scopus
  2. J. D. Haynes and G. Rees, “Decoding mental states from brain activity in humans,” Nature Reviews Neuroscience, vol. 7, no. 7, pp. 523–534, 2006. View at Publisher · View at Google Scholar · View at Scopus
  3. K. A. Norman, S. M. Polyn, G. J. Detre, and J. V. Haxby, “Beyond mind-reading: multi-voxel pattern analysis of fMRI data,” Trends in Cognitive Sciences, vol. 10, no. 9, pp. 424–430, 2006. View at Publisher · View at Google Scholar · View at Scopus
  4. F. Tong and M. S. Pratte, “Decoding patterns of human brain activity,” Annual Review of Psychology, vol. 63, pp. 483–509, 2012. View at Google Scholar
  5. S. Edelman, K. Grill-Spector, T. Kushnir, and R. Malach, “Toward direct visualization of the internal shape representation space by fMRI,” Psychobiology, vol. 26, no. 4, pp. 309–321, 1998. View at Google Scholar · View at Scopus
  6. D. E. Welchew, G. D. Honey, T. Sharma, T. W. Robbins, and E. T. Bullmore, “Multidimensional scaling of integrated neurocognitive function and schizophrenia as a disconnexion disorder,” NeuroImage, vol. 17, no. 3, pp. 1227–1239, 2002. View at Publisher · View at Google Scholar · View at Scopus
  7. N. Kriegeskorte, M. Mur, and P. Bandettini, “Representational similarity analysis—connecting the branches of systems neuroscience,” Frontiers in Systems Neuroscience, vol. 2, pp. 1–28, 2008. View at Google Scholar
  8. H. Abdi and L. J. Williams, “STATIS and DISTATIS: optimum multitable principal component analysis and three way metric multidimensional scaling,” Wiley Interdisciplinary Reviews: Computational Statistics, vol. 4, no. 2, pp. 124–167, 2012. View at Google Scholar
  9. R. D. S. Raizada and A. C. Connolly, “What makes different people's representations alike: neural similarity space solves the problem of across-subject fMRI decoding,” Journal of Cognitive Neuroscience, vol. 24, no. 4, pp. 868–877, 2012. View at Google Scholar
  10. S. V. Shinkareva, V. L. Malave, M. A. Just, and T. M. Mitchell, “Exploring commonalities across participants in the neural representation of objects,” Human Brain Mapping, vol. 33, pp. 1375–1383, 2012. View at Publisher · View at Google Scholar · View at Scopus
  11. A. C. Connolly, M. I. Gobbini, and J. V. Haxby, “Three virtues of similarity-based multivariate pattern analysis: an example from the human object vision pathway,” in Understanding Visual Population Codes: Toward a Common multivariate framework for Cell Recording and functional imaging, N. Kriegeskorte and G. Kreiman, Eds., MIT Press, Cambridge, Massachusetts, 2012. View at Google Scholar
  12. R. M. Nosofsky, “Similarity scaling and cognitive process models,” Annual Review of Psychology, vol. 43, no. 1, pp. 25–53, 1992. View at Google Scholar · View at Scopus
  13. S. Edelman, “Representation is representation of similarities,” Behavioral and Brain Sciences, vol. 21, no. 4, pp. 449–498, 1998. View at Publisher · View at Google Scholar · View at Scopus
  14. S. Edelman and R. Shahbazi, “Renewing the respect for similarity,” Frontiers in Computational Neuroscience, vol. 6, article 45, 2012. View at Google Scholar
  15. E. J. Shoben, “Applications of multidimensional scaling in cognitive psychology,” Applied Psychological Measurement, vol. 7, pp. 473–490, 1983. View at Google Scholar
  16. A. Laakso and G. Cottrell, “Content and cluster analysis: assessing representational similarity in neural systems,” Philosophical Psychology, vol. 13, no. 1, pp. 46–76, 2000. View at Google Scholar · View at Scopus
  17. A. Schurger, F. Pereira, A. Treisman, and J. D. Cohen, “Reproducibility distinguishes conscious from nonconscious neural representations,” Science, vol. 327, no. 5961, pp. 97–99, 2010. View at Publisher · View at Google Scholar · View at Scopus
  18. H. Abdi, L. J. Williams, A. C. Connolly et al., “Multiple Subject Barycentric Discriminant Analysis (MUSUBADA): how to assign scans to categories without using spatial normalization,” Computational and Mathematical Methods in Medicine, vol. 2012, Article ID 634165, 15 pages, 2012. View at Publisher · View at Google Scholar
  19. M. Mur, P. A. Bandettini, and N. Kriegeskorte, “Revealing representational content with pattern-information fMRI—an introductory guide,” Social Cognitive and Affective Neuroscience, vol. 4, no. 1, pp. 101–109, 2009. View at Publisher · View at Google Scholar · View at Scopus
  20. F. Pereira, T. Mitchell, and M. Botvinick, “Machine learning classifiers and fMRI: a tutorial overview,” NeuroImage, vol. 45, no. 1, pp. S199–S209, 2009. View at Publisher · View at Google Scholar · View at Scopus
  21. N. Kriegeskorte, M. Mur, D. A. Ruff et al., “Matching categorical object representations in inferior temporal cortex of man and monkey,” Neuron, vol. 60, no. 6, pp. 1126–1141, 2008. View at Publisher · View at Google Scholar · View at Scopus
  22. S. V. Shinkareva, R. A. Mason, V. L. Malave, W. Wang, T. M. Mitchell, and M. A. Just, “Using fMRI brain activation to identify cognitive states associated with perception of tools and dwellings,” PLoS ONE, vol. 3, no. 1, Article ID e1394, 2008. View at Publisher · View at Google Scholar · View at Scopus
  23. S. V. Shinkareva, V. L. Malave, R. A. Mason, T. M. Mitchell, and M. A. Just, “Commonality of neural representations of words and pictures,” NeuroImage, vol. 54, no. 3, pp. 2418–2425, 2011. View at Publisher · View at Google Scholar · View at Scopus
  24. J. Wang, L. B. Baucom, and S. V. Shinkareva, “Decoding abstract and concrete concept representations based on single-trial fMRI data,” Human Brain Mapping, vol. 34, no. 5, pp. 1133–1147, 2013. View at Google Scholar
  25. L. B. Baucom, D. H. Wedell, J. Wang, D. N. Blitzer, and S. V. Shinkareva, “Decoding the neural representation of affective states,” NeuroImage, vol. 59, no. 1, pp. 718–727, 2012. View at Google Scholar
  26. S. M. Polyn, V. S. Natu, J. D. Cohen, and K. A. Norman, “Neuroscience: category-specific cortical activity precedes retrieval during memory search,” Science, vol. 310, no. 5756, pp. 1963–1966, 2005. View at Publisher · View at Google Scholar · View at Scopus
  27. M. A. Just, V. L. Cherkassky, S. Aryal, and T. M. Mitchell, “A neurosemantic theory of concrete noun representation based on the underlying brain codes,” PLoS ONE, vol. 5, no. 1, Article ID e8622, 2010. View at Publisher · View at Google Scholar · View at Scopus
  28. T. M. Mitchell, S. V. Shinkareva, A. Carlson et al., “Predicting human brain activity associated with the meanings of nouns,” Science, vol. 320, no. 5880, pp. 1191–1195, 2008. View at Publisher · View at Google Scholar · View at Scopus
  29. C. Hiramatsu, N. Goda, and H. Komatsu, “Transformation from image-based to perceptual representation of materials along the human ventral visual pathway,” NeuroImage, vol. 57, no. 2, pp. 482–494, 2011. View at Publisher · View at Google Scholar · View at Scopus
  30. A. C. Connolly, J. S. Guntupalli, J. Gors et al., “The representation of biological classes in the human brain,” The Journal of Neuroscience, vol. 32, no. 8, pp. 2608–2618, 2012. View at Publisher · View at Google Scholar
  31. R. Salvador, J. Suckling, M. R. Coleman, J. D. Pickard, D. Menon, and E. Bullmore, “Neurophysiological architecture of functional magnetic resonance images of human brain,” Cerebral Cortex, vol. 15, no. 9, pp. 1332–2342, 2005. View at Publisher · View at Google Scholar · View at Scopus
  32. D. M. Drucker and G. K. Aguirre, “Different spatial scales of shape similarity representation in lateral and ventral LOC,” Cerebral Cortex, vol. 19, no. 10, pp. 2269–2280, 2009. View at Publisher · View at Google Scholar · View at Scopus
  33. H. P. Op De Beeck, K. Torfs, and J. Wagemans, “Perceived shape similarity among unfamiliar objects and the organization of the human object vision pathway,” Journal of Neuroscience, vol. 28, no. 40, pp. 10111–10123, 2008. View at Publisher · View at Google Scholar · View at Scopus
  34. H. P. Op de Beeck, M. Brants, A. Baeck, and J. Wagemans, “Distributed subordinate specificity for bodies, faces, and buildings in human ventral visual cortex,” NeuroImage, vol. 49, no. 4, pp. 3414–3425, 2010. View at Publisher · View at Google Scholar · View at Scopus
  35. C. Tzagarakis, T. A. Jerde, S. M. Lewis, K. Uǧurbil, and A. P. Georgopoulos, “Cerebral cortical mechanisms of copying geometrical shapes: a multidimensional scaling analysis of fMRI patterns of activation,” Experimental Brain Research, vol. 194, no. 3, pp. 369–380, 2009. View at Publisher · View at Google Scholar · View at Scopus
  36. M. Weber, S. L. Thompson-Schill, D. Osherson, J. Haxby, and L. Parsons, “Predicting judged similarity of natural categories from their neural representations,” Neuropsychologia, vol. 47, no. 3, pp. 859–868, 2009. View at Publisher · View at Google Scholar · View at Scopus
  37. A. J. O'Toole, F. Jiang, H. Abdi, and J. V. Haxby, “Partially distributed representations of objects and faces in ventral temporal cortex,” Journal of Cognitive Neuroscience, vol. 17, no. 4, pp. 580–590, 2005. View at Publisher · View at Google Scholar · View at Scopus
  38. R. M. Cichy, P. Sterzer, J. Heinzle et al., “Probing principles of large-scale object representation: category preference and location encoding,” Human Brain Mapping, 2012. View at Google Scholar
  39. D. Greenstein, J. D. Malley, B. Weisinger, L. Clasen, and N. Gogtay, “Using multivariate machine learning methods and structural MRI to classify childhood onset schizophrenia and healthy controls,” Frontiers in Psychiatry, vol. 3, article 53, 2012. View at Google Scholar
  40. J. H. Steiger, “Tests for comparing elements of a correlation matrix,” Psychological Bulletin, vol. 87, no. 2, pp. 245–251, 1980. View at Publisher · View at Google Scholar · View at Scopus
  41. J. S. Roberts and D. H. Wedell, “Context effects on similarity judgments of multidimensional stimuli: inferring the structure of the emotion space,” Journal of Experimental Social Psychology, vol. 30, no. 1, pp. 1–38, 1994. View at Publisher · View at Google Scholar · View at Scopus
  42. M. E. Hasselmo, E. T. Rolls, and G. C. Baylis, “The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey,” Behavioural Brain Research, vol. 32, no. 3, pp. 203–218, 1989. View at Google Scholar · View at Scopus
  43. H. Op De Beeck, J. Wagemans, and R. Vogels, “Inferotemporal neurons represent low-dimensional configurations of parameterized shapes,” Nature Neuroscience, vol. 4, no. 12, pp. 1244–1252, 2001. View at Publisher · View at Google Scholar · View at Scopus
  44. R. Kiani, H. Esteky, K. Mirpour, and K. Tanaka, “Object category structure in response patterns of neuronal population in monkey inferior temporal cortex,” Journal of Neurophysiology, vol. 97, no. 6, pp. 4296–4309, 2007. View at Publisher · View at Google Scholar · View at Scopus
  45. A. B. Sereno and S. R. Lehky, “Population coding of visual space: comparison of spatial representations in dorsal and ventral pathways,” Frontiers in Computational Neuroscience, vol. 4, article 159, 2011. View at Google Scholar
  46. S. R. Lehky and A. B. Sereno, “Comparison of shape encoding in primate dorsal and ventral visual pathways,” Journal of Neurophysiology, vol. 97, no. 1, pp. 307–319, 2007. View at Publisher · View at Google Scholar · View at Scopus
  47. M. P. Young and S. Yamane, “Sparse population coding of faces in the inferotemporal cortex,” Science, vol. 256, no. 5061, pp. 1327–1331, 1992. View at Google Scholar · View at Scopus
  48. I. Borg and P. Groenen, Modern Multidimensional Scaling: Theory and Applications, Springer, New York, NY, USA, 1997.
  49. Z. Zhang and Y. Takane, “Statistics: multidimensional scaling,” in International Encyclopedia of Education, E. Baker, B. McGaw, and P. P. Peterson, Eds., pp. 304–311, Elsevier, Oxford, UK, 2010. View at Google Scholar
  50. Y. Takane, S. Jung, and Y. Oshima-Takane, “Multidimensional scaling,” in Handbook of Quantitative Methods in Psychology, R. E. Millsap and A. Maydeu-Olivares, Eds., pp. 219–242, Sage, London, UK, 2009. View at Google Scholar
  51. R. N. Shepard, “Attention and the metric structure of the stimulus space,” Journal of Mathematical Psychology, vol. 1, no. 1, pp. 54–87, 1964. View at Google Scholar · View at Scopus
  52. P. J. F. Groenen and W. J. Heiser, “The tunneling method for global optimization in multidimensional scaling,” Psychometrika, vol. 61, no. 3, pp. 529–550, 1996. View at Google Scholar · View at Scopus
  53. L. Hubert, P. Arabie, and M. Hesson-Mcinnis, “Multidimensional scaling in the city-block metric: a combinatorial approach,” Journal of Classification, vol. 19929, no. 2, pp. 211–236, 1992. View at Google Scholar
  54. R. N. Shepard, “The analysis of proximities: multidimensional scaling with an unknown distance function—I,” Psychometrika, vol. 27, no. 2, pp. 125–140, 1962. View at Publisher · View at Google Scholar · View at Scopus
  55. R. N. Shepard, “The analysis of proximities: multidimensional scaling with an unknown distance function—II,” Psychometrika, vol. 27, no. 3, pp. 219–246, 1962. View at Publisher · View at Google Scholar · View at Scopus
  56. P. H. Schönemann and R. M. Carroll, “Fitting one matrix to another under choice of a central dilation and a rigid motion,” Psychometrika, vol. 35, no. 2, pp. 245–255, 1970. View at Publisher · View at Google Scholar · View at Scopus
  57. L. R. Tucker and S. Messick, “An individual differences model for multidimensional scaling,” Psychometrika, vol. 28, no. 4, pp. 333–367, 1963. View at Publisher · View at Google Scholar · View at Scopus
  58. J. D. Carroll and J. J. Chang, “Analysis of individual differences in multidimensional scaling via an n-way generalization of "Eckart-Young" decomposition,” Psychometrika, vol. 35, no. 3, pp. 283–319, 1970. View at Publisher · View at Google Scholar · View at Scopus
  59. D. E. Welchew, C. Ashwin, K. Berkouk et al., “Functional disconnectivity of the medial temporal lobe in Asperger's syndrome,” Biological Psychiatry, vol. 57, no. 9, pp. 991–998, 2005. View at Publisher · View at Google Scholar · View at Scopus
  60. G. A. Tagaris, S. G. Kim, J. P. Strupp, P. Andersen, K. Uǧurbil, and A. P. Georgopoulos, “Quantitative relations between parietal activation and performance in mental rotation,” NeuroReport, vol. 7, no. 3, pp. 773–776, 1996. View at Google Scholar · View at Scopus
  61. H. Abdi, J. P. Dunlop, and L. J. Williams, “How to compute reliability estimates and display confidence and tolerance intervals for pattern classifiers using the Bootstrap and 3-way multidimensional scaling (DISTATIS),” NeuroImage, vol. 45, no. 1, pp. 89–95, 2009. View at Publisher · View at Google Scholar · View at Scopus
  62. F. Kherif, J. B. Poline, S. Mériaux, H. Benali, G. Flandin, and M. Brett, “Group analysis in functional neuroimaging: selecting subjects using similarity measures,” NeuroImage, vol. 20, no. 4, pp. 2197–2208, 2003. View at Publisher · View at Google Scholar · View at Scopus
  63. N. W. Churchill, A. Oder, H. Abdi et al., “Optimizing preprocessing and analysis pipelines for single-subject fMRI—I. Standard temporal motion and physiological noise correction methods,” Human Brain Mapping, vol. 33, pp. 609–627, 2012. View at Publisher · View at Google Scholar · View at Scopus
  64. C. Lavit, Y. Escoufier, R. Sabatier, and P. Traissac, “The ACT (STATIS method),” Computational Statistics and Data Analysis, vol. 18, no. 1, pp. 97–119, 1994. View at Google Scholar · View at Scopus
  65. H. Abdi and D. Valentin, “STATIS,” in Encyclopedia of Measurement and Statistics, N. J. Salkind, Ed., pp. 955–962, Sage, Thousand Oaks, Calif, USA, 2007. View at Google Scholar
  66. R. A. Johnson and D. W. Wichern, Applied Multivariate Statistical Analysis, Prentice Hall, 6th edition, 2007.
  67. P. Arabie, L. J. Hubert, and G. De Soete, Clustering and Classification, World Scientific Publishing, 1999.
  68. S. Landau and I. C. Ster, “Cluster analysis: overview,” in International Encyclopedia of Education, pp. 72–83, 2010. View at Google Scholar
  69. I. D. Popivanov, J. Jastorff, W. Vanduffela et al., “Stimulus representations in body-selective regions of the macaque cortex assessed with event-related fMRI,” NeuroImage, vol. 63, pp. 723–741, 2012. View at Publisher · View at Google Scholar
  70. J. Haushofer, M. S. Livingstone, and N. Kanwisher, “Multivariate patterns in object-selective cortex dissociate perceptual and physical shape similarity,” PLoS Biology, vol. 6, no. 7, article e187, pp. 723–741, 2008. View at Publisher · View at Google Scholar · View at Scopus
  71. J. V. Haxby, M. I. Gobbini, M. L. Furey, A. Ishai, J. L. Schouten, and P. Pietrini, “Distributed and overlapping representations of faces and objects in ventral temporal cortex,” Science, vol. 293, no. 5539, pp. 2425–2430, 2001. View at Publisher · View at Google Scholar · View at Scopus
  72. S. J. Hanson, T. Matsuka, and J. V. Haxby, “Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: Is there a “face” area?” NeuroImage, vol. 23, no. 1, pp. 156–166, 2004. View at Publisher · View at Google Scholar · View at Scopus
  73. J. Onton and S. Makeig, “High-frequency broadband modulations of electroencephalographic spectra,” Frontiers in Human Neuroscience, vol. 3, article 61, 2009. View at Google Scholar
  74. W. Braet, J. Wagemans, and H. Op de Beeck, “The visual word form area is organized according to orthography,” NeuroImage, vol. 59, pp. 2751–2759, 2012. View at Google Scholar
  75. F. A. Soto, J. G. Waldschmidt, S. Helie, and F. G. Ashby, “Brain activity across the development of automatic categorization: a comparison of categorization tasks using multi-voxel pattern analysis,” NeuroImage, vol. 71, pp. 284–297, 2013. View at Publisher · View at Google Scholar
  76. G. K. Aguirre, “Continuous carry-over designs for fMRI,” NeuroImage, vol. 35, no. 4, pp. 1480–1494, 2007. View at Publisher · View at Google Scholar · View at Scopus
  77. Z. Yang, X. N. Zuo, P. Wang et al., “Generalized RAICAR: discover homogeneous subject (sub)groups by reproducibility of their intrinsic connectivity networks,” NeuroImage, vol. 63, pp. 403–414, 2012. View at Publisher · View at Google Scholar
  78. F. Janoos, R. Machiraju, S. Singh, and I. Á. Morocz, “Spatio-temporal models of mental processes from fMRI,” NeuroImage, vol. 57, no. 2, pp. 362–377, 2011. View at Publisher · View at Google Scholar · View at Scopus
  79. K. J. Friston, C. D. Frith, P. Fletcher, P. F. Liddle, and R. S. J. Frackowiak, “Functional topography: multidimensional scaling and functional connectivity in the brain,” Cerebral Cortex, vol. 6, no. 2, pp. 156–164, 1996. View at Publisher · View at Google Scholar · View at Scopus
  80. P.-Y. Hervé, A. Razafimandimby, M. Vigneau et al., “Disentangling the brain networks supporting affective speech comprehension,” NeuroImage, vol. 61, pp. 1255–1267, 2012. View at Publisher · View at Google Scholar
  81. A. Etkin and T. D. Wager, “Functional neuroimaging of anxiety: a meta-ana lysis of emotional processing in PTSD, social anxiety disorder, and specific phobia,” American Journal of Psychiatry, vol. 164, no. 10, pp. 1476–1488, 2007. View at Publisher · View at Google Scholar · View at Scopus
  82. J. de Leeuw and P. Mair, “Multidimensional scaling using majorization: SMACOF in R,” Journal of Statistical Software, vol. 31, no. 3, pp. 1–30, 2009. View at Google Scholar · View at Scopus
  83. S. Dray, A. B. Dufour, and D. Chessel, “The ade4 package—II: two-table and K-table methods,” R News, vol. 7, no. 2, pp. 47–52, 2007. View at Google Scholar
  84. L. Hubert, H.-F. Koehn, and D. Steinley, “Cluster analysis: a toolbox for MATLAB,” in Handbook of Quantitative Methods in Psychology, R. E. Millsap and A. Maydeu-Olivares, Eds., pp. 444–512, Sage, London, UK, 2009. View at Google Scholar