Review Article | Open Access
Tuomo Kujala, Pertti Saariluoma, "Cognitive Mimetics for Designing Intelligent Technologies", Advances in Human-Computer Interaction, vol. 2018, Article ID 9215863, 9 pages, 2018. https://doi.org/10.1155/2018/9215863
Cognitive Mimetics for Designing Intelligent Technologies
Design mimetics is an important method of creation in technology design. Here, we review design mimetics as a plausible approach to address the problem of how to design generally intelligent technology. We argue that design mimetics can be conceptually divided into three levels based on the source of imitation. Biomimetics focuses on the structural similarities between systems in nature and technical solutions for solving design problems. In robotics, the sensory-motor systems of humans and animals are a source of design solutions. At the highest level, we introduce the concept of cognitive mimetics, in which the source for imitation is human information processing. We review and discuss some historical examples of cognitive mimetics, its potential uses, methods, levels, and current applications, and how to test its success. We conclude by a practical example showing how cognitive mimetics can be a highly valuable complimentary approach for pattern matching and machine learning based design of artificial intelligence (AI) for solving specific human-AI interaction design problems.
Mimetic design is an important design methodology. It refers to technology design in which designers imitate some existing phenomenon or system to generate new technological solutions. The paragons can be anything, but often they are phenomena or systems of nature . Yet, mimicking is not necessarily a simple concept. Design mimetics have often focused on structural and physical similarity between entities of nature and technical solutions. However, the structural and physical similarity between the source and idea may not be sufficient for getting the best out of mimicking. There are classes of design problems, which are not structural or physical but still could be of real use, if designers could find new ideas by studying possible solutions via mimicry. In this paper, our goal is to reanalyze design mimetics at a conceptual level in order to explicate the ways it can serve as an approach for addressing the problem of how to design technological solutions with artificial general intelligence .
Designing intelligent systems is becoming a core area in developing modern technologies . Machine translation, image and speech recognition systems, self-driving cars, chatbots, and robot help desks are examples of current technological trends. All of these intelligent (or “smart”) technologies are enabled by artificial intelligence (AI) based on neural networks, pattern recognition, and machine learning. The consequence of these new developments is that computers are becoming more relevant in replacing or reallocating people in tasks, in which so far it has been necessary to use people in order to get the systems to work. Nevertheless, true progress in this area presupposes in-depth understanding of the human cognitive processes that should be replaced by machines. Therefore, it makes sense to rethink the conceptual foundations of design mimetics in this new technological era.
A naïve but intuitive example might help to clarify our position. Consider the way in which design mimetics could be used in designing a cyborg pianist. The first problem is to create the hands that play the piano. They must be like human hands with respect to size and elasticity of movement. They should have the right pressure, timing, and tempo to play like Lang Lang (a well-known Chinese concert pianist). Pianist robots’ coordination should be able to mimic the sensory-motor processes of a human pianist. It should be able to hear the notes and respond accordingly.
A critical question here is whether the imitation of the human hands and eye-hand coordination processes are sufficient in expressing all human skills in piano playing. Skilled pianists often use their hands to play the keyboard in a routine manner but they also have to solve unique and complex problems. They have to rely on higher cortical processes such as categorization, inference, decision making, problem solving, and constructive thinking in order to be able to create new artistic visions and interpretations .
In building intelligent systems such as autonomous robots, it is thus not necessarily sufficient to mimic biological structures but it is also necessary to mimic sensory-motoric and even different levels of higher intellectual processes. To explain and to mimic a human expert’s skills, one has to go beyond mere mechanical and sensory-motor levels towards even emotional modeling to be able to comprehend and model a creative and skilled pianist. Here, our common sense example could have been about any human expert at work. The key message is that, to replace activities of human experts with machine intelligence, it is necessary to model and mimic many levels of physical and intellectual work.
In this paper, we will argue for a three-level conceptual model of design mimetics and introduce a novel concept of cognitive mimetics to refer to the mimicry of higher cognitive processes for designing intelligent technology. The main goal of the paper is to review and argue for the need of cognitive mimetics in order to design artificial general intelligence  and intelligent human-AI interactions. In a world overrun with pattern recognition and machine learning approaches to AI, we suggest that mimicking actual cognitive processes in AI design is a matter for further consideration. Cognitive mimetics may prove to be an increasingly important design approach as it is expected that, in the near future, we will encounter novel interaction challenges in our confrontations with ubiquitous AI .
2. Three Levels of Mimetic Design
New design ideas often utilize existing solutions for problems of similar types. The main attribute of mimicry is that the solution for a design problem is found by imitating some existing object or system. The phenomenon that is the paragon for the design solution can be called the source and outcome idea. Mimicry has always been a component of engineering thinking [5, 6]. The Wright brothers as well as Leonardo da Vinci observed how birds flied and imitated these to design an airplane . One can easily find numerous examples of respective design processes in which some aspect of nature has been mimicked to create new technological solutions. In the 1950s, this kind of design was attributed the label “design mimetics.” As the source was often nature, the design approach was coined biomimetics by Otto Schmitt . Ever since, it has had a solid role in engineering. We argue that there are three main levels of design mimetics that can be utilized when designing intelligent technology. In the following chapters, we will briefly discuss each level of mimetic design.
2.1. Mimicking Structural Similarities
An effective way of approaching the problems of replacing human capacities in work has been biomimetics (also biomimicry or bionics). It is an engineering paradigm, which is based on the imitation of the models, systems, and elements of nature for the purpose of solving complex technological problems [1, 6, 7]. A traditional part of biomimetics is based on imitating the processes of nature on the physical level. For example, bird wings were models and inspiration for designing airplane wings, which could enable airplanes to fly and thus enabling people to fly. The focus of biomimetics is thus more on designing a physical object than on replacing people with machines.
Biomimetics has been a very successful way to ideate new technological solutions from nanometric levels to large technical structures. The way evolution has “solved” construction problems can be applied to the technological sphere, though the solutions need not be identical. For example, the wings of any man-made flying technical artifact are not exactly bird wings, but still one can find many analogical properties. There are numerous examples of working technical solutions, of which design processes have been based on biomimetics. Robots may resemble ants or tortoises. Many fabrics have their origins in studies on biological organisms. Connectionist computational models of artificial intelligence have been inspired by neural networks . Even recently, designers have learned more by studying the wings of the birds when designing airplanes and drones . In photonics, engineers were inspired by the reflecting properties of butterfly wings, when they invented new display technologies .
Biomimetics illustrates some important properties of mimicry in design. Firstly, imitation is an important source of ideas in design thinking. Secondly, the source and idea are not identical. Rather, they exist in dialogue with one another. Consequently, much of the information required to generate the final solution is not directly related to the source. Thus, metals and rivets in airplane wings have little to do with bird wings. Furthermore, the solution does not need to be as equally efficient as the source. Instead, it may improve the original performance. Caterpillars are much more efficient in working with soil than human hands. The focus of mimicry is to advance forward in design thinking by finding key solutions.
In a closer look, it is problematic as to how well biomimetics suit the purposes of designing intelligent technologies. It rather concentrates on the structural and physical solutions for design problems such as the structures of robots, architectural solutions, or properties of materials and molecules. Structural similarities are not necessarily sufficient for innovating modern intelligent technologies.
2.2. Mimicking Sensory-Motor Processes
The story of industrial robotics is mostly very different from that of mimicking structural similarities. The goal of robots is to replace people in tasks, in situations where, for instance, people are not necessary, or in situations that are dangerous for humans. A substantial amount of industrial robotics, from a mimicry perspective, models the sensory-motor systems of human. Today, for instance, dexterity is one of the key problems in robotics as it would give robots new application areas .
A welding robot recognizes the metal body of a car, moves to the right welding spot, and finally welds the pieces together. Actually, the robot does everything that a welder would do and for this reason, it is possible to free people from many routine welding tasks. There are a large number of robots in similar tasks. They can pack things, they can take mail parcels, or they can operate in harbors, to take some examples. People have earlier carried out these tasks, as it was not possible to build sufficiently accurate robots. Computers have made it possible to reach sufficient accuracy in sensory-motor processing and get these kinds of robots to work.
The first robotic arms were created to replace human arms. Therefore, in this sense, they are imitating a human arm. However, there is more in them. They have sensors and programs, which control their behavior. Wiener’s  theories of cybernetics and control were important in creating the first-generation automation robots in the sixties. They had sensors and some versions, such as Grey Walter’s tortoises, could even wander around in one’s apartment . From the mimicking point of view, they had new kinds of properties. They could process information.
Early industrial robots carried out tasks, in which human operators relied on their sensory-motor information processing. In welding cars on conveyer belts, the robots are not supposed to think. They just carefully inspect the parts they need to join and then weld them together. Only in fault situations are more complex actions required, but these are typically rare and are often handled by people. Thus, one only needs to coordinate sensory information with movements to carry out these kinds of tasks. Nevertheless, in order to construct robots, one needs to additionally imitate human sensory-motor information processing in addition to biological structures. This kind of mimicry is qualitatively different in comparison to traditional biomimetics.
Imitation of sensory-motor processes only represents the lowest level of information processing mimetics. Machine vision is not only about enabling the machine to see things but also about actively recognizing objects. The recent developments in artificial intelligence and the rise of autonomous technologies call attention to yet another kind of information processing mimetics. This is based on imitating higher cognitive processes such as thinking.
2.3. Mimicking Higher Cognitive Processes
Human information processing is an interesting source for imitation. It is clearly different from structural biomimetics and also from sensory-motor mimetics, although the notion of embodied cognition  somewhat blurs the distinction between these levels of mimetics. There are many possibilities for naming this level of design mimetics. Perhaps the most logical term is cognitive mimetics as the source is human information processing. Human information processing has traditionally been called cognition . Thus, all types of mimetics which are built on the idea of imitating human information processing can be called cognitive mimetics. This is in order to distinguish this form of mimetics from the lower levels of design mimetics.
As far as designers will improve physical and physiological properties of traditional human work such as sensory-motor processes on assembly lines by means of industrial robotics, they can rely on imitating and improving biological sensors and body movements. However, moving the scope of traditional biomimetics to the design of autonomous, intelligent technologies means an essential change of focus. This change of focus entails the shift from mimicking physical structures or sensory-motor processes to the higher cognitive processes. Instead of mimicking the physical movement of body limbs, which is common in assembly line robots, it has already become increasingly more important to mimic human intelligence and higher cognitive processes. Mental processes such as language comprehension and production, categorization, decision making, inference, problem solving, and constructive thinking will become more important in design mimetics.
Cognitive processes are important for human survival and they make it possible for people to behave in a flexible and creative manner. People can respond selectively and rationally to situations in which they have never been before (i.e., general intelligence). This means that people are different from many animals, as they are able to adapt more efficiently to new environmental conditions in an intentional manner and they can invent new ways of meeting the environmental demands. Thus, cognitive processes give people much more independence as regards variation in environment as compared to other animals.
When the goal of technology is to replace human intellectual performance, the understanding of cognitive processes and using this knowledge become important in design. In particular, artificial intelligence and robots can benefit from understanding human cognition and information processing as these will be cooperating more and more with people in novel sociotechnical systems. Generally, intelligent autonomous systems are technical devices that can flexibly and rationally respond to stimuli and environmental situations that they have not met before or which have not been programmed in advance. Thus, the stimulus-independence typical to the human mind should be one of the main criteria of (human-like) intelligence of autonomous systems (i.e., artificial general intelligence ). In contrast to biomimetics, cognitive mimetics concentrates on analyzing the human information processes and building intelligent systems on the grounds of modeling how people process information.
The three levels of design mimetics based on the source of imitation are presented in Table 1. Next, we will take a closer look on cognitive mimetics and argue more for its importance in designing intelligent technology.
3. Cognitive Mimetics
3.1. The Brief History of Mimicking Human Cognition
Cognitive mimetics is a unique design conception. However, it is based on the very core knowledge of modern cognitive science. The first example of mimicking human information processing is perhaps Turing’s [17, 18] model of a mathematician, that is, the Turing machine. The idea led to the birth of computers and information technology. The core of Turing’s idea was to construct a model or imitation of how mathematicians solve mathematical problems. Thus, his focus was not on structural aspects or sensory-motor processes of people but on how they process information. Turing’s insights led to a number of important prototypical ways of thinking, which can be seen as the first examples of cognitive mimetics.
An excellent early example of cognitive mimetics can be found in game playing algorithms. Game playing became one of the first challenges for designing technical systems, which had some resemblance to the human mind . The challenge was set in the early fifties by Turing  and Shannon . De Groot  collected chess players’ thinking-aloud protocols and noticed how they used pruned tree searches. Similarly, early AI researchers suggested that heuristic tree search might be a solution to be used by machines in solving search problems . Consequently, through heuristic search, chess was used for forty years as a context for developing human-like artificial intelligence. In this example, the way human chess players processed information became the model of machine information processing. Thus, it was not any feature of a machine or any biological property of a human brain but the way people process information that became the model of this class of AI systems. Tree search was a suitably similar process between chess-playing computers and chess players, rendering it possible to use cognitive mimicry to develop machines capable of intellectual tasks possible only for people beforehand . As is well known, a computer chess program could finally beat a chess world champion in 1997. More recently, examples can be seen in IBM Watson’s  victory over two human experts in the Jeopardy game show in 2011 and also in Google’s Deep Mind’s victory over a grandmaster player in the Chinese game Go in 2016 .
A few years after Turing and Shannon’s game-playing programs, in 1958, John McCarthy developed the term artificial intelligence (AI) to describe a new field of engineering . At that time, one could find a number of important systems, which to some degree mimicked human information processing. Logic theories, Checkers, transformation grammar, and related computational linguistics can be taken as examples .
In early 1940s, another important line of cognitive mimicry began. McCullough and Pitts developed an AI system later known as Perceptron, which finally led to the fields of neurocomputing and connectionism [9, 27, 28]. These approaches to AI were developed on the ground of mimicking (at a highly reduced level) how human nerve cells and neural networks operate .
Later, symbolic production systems known as cognitive architectures, such as SOAR [29, 30] and ACT-R , were developed based on the General Problem Solver by Newell and Simon . The cognitive models built on these systems tried to mimic the symbolic (representational) level of human information processing in the constraints given by the general cognitive architecture. In the 1970s, production systems were considered to be the key to modeling cognition, whereas in the 1980s and 1990s, connectionist approaches once again gained popularity in attempts to create AI and expert systems due to observed limitations in the production systems’ capabilities to create AI. Since the 1990s, probabilistic models of human cognition based on Bayesian modeling have been replacing both the connectionist and production models among cognitive scientists due to their ability to significantly increase representational complexity . Recently, the rapid successes of deep learning systems in several application domains (e.g., [2, 23, 24]) have brought neural networks that are capable of impressive pattern recognition capacity superior to humans back into the public spotlight. This is due to the advances in computing power, big data, and algorithms. However, these approaches are currently very different from the way human cognition operates [2, 32].
AI is a central concept in designing new intelligent technologies. However, cognitive mimetics and AI are not one and the same concept. Cognitive mimetics is one approach for designing and innovating intelligent technologies. AI can but it does not need to be based on cognitive mimetics. Analogously, all technology design does not rely on biomimetics, although it has been proven to be an important aid in design.
Cognitive mimetics presupposes the understanding of how both higher cognitive processes operate in human mind and how these processes can be imitated by computers. This problem belongs to the very core of cognitive science. The problem is the property of multiple realizability , which means that cognitive processes can be realized in human minds as well as in animals and technical systems.
However, the goal of cognitive mimetics is not to slavishly imitate human cognitive processes nor is it to construct devices that can perform tasks as effectively as people. The goal should rather be to produce technical systems that surpass human levels so that they can be of real help for improving human life. A pocket calculator that would make the same number of errors as people would not serve its purpose as well as they do today. Yet, a design is based on cognitive mimicry when the system has elements that can be identified and ideated on the grounds of human information processing.
Thus, a chess machine need not exactly search in the same way as people do. Indeed, these machines do not work in a similar manner to people. The machines consider hundreds of millions of moves, while people often do not generate more than fifty mental moves. Computer chess programs are similar to people in that they use very similar tree search process. Yet, they vary in their inability to distinguish between essential and inessential alternatives. The programs have to replace the selectivity by brute force. Their performance is as effective as that of any human being and if needed, they could replace people in chess competitions. Current mainstream approaches to the design of intelligent systems rely mostly on the enormous data crunching capacity of modern computers, machine learning, and pattern recognition in big data [2, 32, 34]. Cognitive mimetics can be a complementing approach to the design of generally intelligent autonomous systems that could better communicate, interact, and cooperate with humans. For instance, Strabala et al.  have shown that it is possible to model the way in which people hand over objects to each other (what, when, and where information) and to utilize the procedure in improving human-robot handovers. This is an example of a task that is trivial for humans, while it has been proven difficult to implement for robots.
Human capabilities exceed machine capabilities in certain tasks and vice versa. Thus, a critical target design task for cognitive mimetics is to find the optimal division of work between the AI and the human operator (see, e.g., ). One of the general tasks in which the human mind is (still) supreme over the machine is the finding of situationally relevant information and subgoals out of large amounts of available situational and dynamic data. Other critical tasks for cognitive mimetics include the modeling of optimal information sharing and control shifts in order to guarantee the highest level of situation awareness regarding the task-relevant information for both the human cooperator/supervisor and AI systems.
In addition, domain-specific expert behaviors can be modeled in order to find situation-specific goal prioritization and goal selection rules for each task of an AI system in the domain. For instance, Soh and Demiris  have developed an expert model that is capable of learning a human expert’s tacit knowledge from demonstration. Their study indicates that it is both possible and useful to use algorithms to learn shared control policies by observing a human expert in the domain of smart wheelchair assistance for the disabled (i.e., how and when to assist).
The methods used in cognitive mimetics can also be based on computational modeling approaches such as ACT-R , which are capable of modeling the constraints of human information processing. However, the applicable methods are not limited to existing cognitive architectures. Recent computational design approaches for interaction design (e.g., ) try to optimize user interfaces by modeling users’ behaviors with reinforcement learning and other machine learning algorithms. Compared to the modeling of average human behavior that has been of main focus since the 1980s with cognitive architectures (e.g., ACT-R ), the main goal in cognitive mimetics is to understand and model expert human behavior at such a level of detail that the behavior could be replicated by a computer. This is in line with the original idea behind cognitive modeling as introduced by Newell and Simon . However, this approach necessitates understanding and modeling human error as well, as expertise is typically gained by significant experience on exposure to various kinds of even exceptional trial and error situations. The observation of only perfect task behavior and imitation of these by a machine would only lead to an unintelligent machine that would not be capable of adjusting its behaviors to unexpected, even minor, changes in situation parameters . Reinforcement learning  is a machine learning method that has been found to be highly useful in teaching machines “bounded rationality”  similar (or superior) to expert humans in a given task, with given goals, constraints, and rewards, after a large number of task simulations .
The ultimate key to success in cognitive mimetics would be to create systems that are able to rapidly modify and learn to adjust their behaviors in a similar fashion to a human expert according to the recognition of a meaningful change in situation parameters [2, 32]. As plausible key solutions, Lake et al.  have suggested that generally intelligent artificial systems should have the same capacities as those of a human infant (innate or learned ) to(1)build causal models of the world which support explanation and understanding (rather than mere pattern recognition),(2)ground learning in intuitive theories of physics (e.g., persistence and continuity of objects) and psychology (e.g., human agents having intentions, beliefs, and goals),(3)harness construction of new representations through the combination of primitive elements and learning-to-learn (i.e., learning a new task or concept can be accelerated through previous or parallel learning of other related tasks or other related concepts).
These capacities enable humans to rapidly acquire and generalize knowledge for novel tasks and situations.
The ideas of brains as an embodied prediction machine (e.g., ) may well offer cognitive science the grand unified theory of the mind. When these predictive processing models are coupled with Bayesian models of learning and inference , they may be the most promising current approach in this respect (1.-3. above). Other recent candidates for a grand unified theory of cognition (e.g., ) have considered analogical thinking as the core feature of human cognition (likewise it is the core of design mimetics). How to implement these kinds of innate capacities, structures, and mechanisms in AI remains an open question, but if it is solved, the consequences for the development of AI could be immense.
So far, utilization of cognitive mimetics in the design of AI has been fairly limited. As reviewed earlier, biological neural networks were the early inspiration for artificial neural networks. Tree search similar to human search has been used since 1950s in a number of AI solutions. These solutions range from different games to logic, fifth-generation computers, and, most recently, in Google’s AlphaGo variants beating the best human experts in the game of Go [24, 40]. Reinforcement learning was a key to the superhuman performance of the AlphaGo Zero in the same game . Reinforcement learning can be seen as highly similar to the behaviorist view of human learning, which was found to be significantly deficient for explaining human learning in the so-called cognitive revolution of the 1950s [38, 43].
There may well be many other examples of the success of cognitive mimetics in the design of intelligent technology. However, one can ask if cognitive mimetics has been utilized sufficiently in the design of AI for achieving artificial general intelligence [2, 34]. From this point of view, Marcus  has argued for the necessity of hybrid AI systems, which would more closely resemble the organization of human cognition. A hybrid AI system could have various parallel subsystems, maybe similar to deep learning networks, but that are orchestrated by higher-level mechanisms similar to reinforcement learning, as well as by central executive processes working at an even higher symbolic level. AlphaGo Zero  is a recent example of how a hybrid system (combining deep learning, reinforcement learning, and tree search) can be superior to pure deep learning systems. Yet, the symbolic level of processing is still absent from systems such as AlphaGo Zero, which may limit its intelligence to certain domains (e.g., gaming).
3.5. Tests of Success
There are a number of suggested means that could be applied to test the success of cognitive mimetics, of which the most famous is Turing’s test . It can be used to assess whether the performance of an intelligent program is as good as the performance of a human being. Turing’s test does not evaluate if a system processes information like people but it evaluates whether it can perform as well as people in an intellectual task. This is important when the replacement or reallocation of human work by technical systems is considered .
The original goal of Turing’s  test was to answer one question: Can machines think (i.e., are machines intelligent)? The Turing test is an imitation game. The decisive criterion in these experiments is the capacity of the human interrogator to say whether the answer to a question was given by human or machine. If the interrogator cannot do this, then the machine has passed the test. Turing argued that if machines can imitate human thinking perfectly, they are intelligent. Therefore, the outcome of the experiment is that machines can think if they can perform human tasks in such a way that it is impossible for a competent observer to see the difference between human and machine.
Turing’s imitation game gives an explicit (behavioristic) form of how to compare human and machine behaviors in intelligent tasks. Since the discussion on the intelligence of machines underpins much of modern cognitive science, psychology, and philosophy of the mind and it is also essential in developing AI robots and autonomous systems, it makes sense to consider the true value of Turing’s test for both theoretical and practical purposes [44, 45]. To pass this test can be argued to be the ultimate goal for optimal interaction and communication between humans and an AI system in several practical domains, even if the pass would not imply strong AI in the sense of Searle .
However, one could ask as to whether or not it is enough for a system to pass the Turing test in a particular task in order to be as (generally) intelligent as a human. Does it matter how the system has reached this level in performance and if it is able to pass the test also in other tasks (i.e., generalizability of the skills)? The question dates back to a long-standing, but unsolved, debate between machine learning researchers (including statisticians) and linguists (including psychologists) .
Lake et al.  have recently published an extensive literature review comparing the current high-end pattern recognition systems’ (i.e., neural networks’) performance to human performance. They have also discussed what may be lacking in these systems preventing them from reaching the level of human skills. They argue that, despite the biological inspiration and performance achievements, the deep learning pattern recognition systems differ from human intelligence in crucial ways. They put forward strong arguments for cognitive mimetics without using the concept explicitly. Nowadays, pattern recognition system may be taught to reach a comparable, or higher, level of performance than a human in a specific task (e.g., a video game). However, the difference in the required amount of training between a human child and the system to achieve a comparable level of performance can be calculated in hundreds or even thousands of hours. Furthermore, a child can learn and handle a small change in game dynamics easily. A pattern recognition system may require full reconfiguration and a significant amount of training before reaching again a high level of performance. These observations suggest (at least) three criteria for a system to be as intelligent as a human cooperator:(1)Pass in Turing’s test(2)Comparable level of performance with a comparable amount of training(3)Generalizability of the acquired skills and knowledge to other tasks
AlphaGo Zero, as described by Silver et al. , may be argued to be able to pass easily 1. and to an extent also 2. in the game of Go. AlphaGo Zero has demonstrated not only human-level performance but also “superhuman proficiency” in the game. In addition, Silver et al.  argue that it achieved human level of performance without human (move) data only by reinforcement learning from self-play over less than 40 hours of self-training. Inarguably, these amazing results indicate the efficiency of the reinforcement learning approach for achieving superior performance in one particularly challenging domain for human cognition. However, as Marcus  points out, it remains a question as to how well and easily AlphaGo Zero’s intelligence in this particular board game generalizes beyond gaming and even to other types of games, such as video games. Marcus  further argues that, despite Silver et al.  claiming that AlphaGo Zero was able to achieve superhuman proficiency “tabula rasa” without any knowledge of human Go games and moves, a critical aspect of its success was the tree search and reward logic of the reinforcement learning, which were built-in by its human creators. These critical aspects are highly similar to the mechanisms human players utilize in the game of Go. For the generalizability of the AI produced by cognitive mimetics, it is not sufficient that the AI design is able to produce seemingly intelligent behavior (i.e., pass Turing’s test), but the types of processes that produce this behavior and how generalizable the artificial intelligence is across different tasks are what matters.
4. Application Example: Interactions with Autonomous Vehicles
The utility of cognitive mimetics for the design of intelligent technology can be illustrated by a practical example. Autonomous vehicles (i.e., self-driving cars) are expected to be one of the megatrends of autonomous AI technologies in the near future. However, according to an analysis by the University of Michigan Transportation Research Institute , unexpectedly an autonomous car may be statistically more likely to be involved in an accident than a car with a human driver per million miles traveled. The severity of the accidents seems to be lower, the cars were not considered to be at fault in any accident, and most of the accidents were rear-end crashes (the autonomous car was hit from the back by a human driver). However, the findings seem to suggest that there could be something unexpected in the behavior of an autonomous car which can lead human drivers to be misinterpreted by the car’s behaviors.
At intersections and junctions in particular, a common rhythm by the vehicles in a queue is highly important for the flow and safety of the traffic. A major advantage of an autonomous vehicle over a human driver is its ability to detect potentially risky situations well ahead of the human and react to these at a much higher intensity. The downside can be unexpectedly hard braking behaviors in situations where there is a false positive detection. For instance, a bicyclist approaching a crossing but who gives a sign of eye contact and yielding that is efficiently recognizable by a human driver, but not by an autonomous vehicle, can lead to unexpected behaviors. As long as there are human pedestrians, cyclists, or drivers in the traffic among the autonomous vehicles, the problem is real. The issue is even more pronounced in highly unstructured traffic environments, such as crowded city centers. In these environments, the human driver is able to take the own space even by aggressive gestures and other ways of human communication with fellow road users. Meanwhile, an autonomous vehicle can simply cease to move because it detects continuous possibility of crossing objects.
A recent study by Brown and Laurier  demonstrates how current autopilot systems (Tesla autopilot and Google self-driving car) are highly inefficient in detecting the intentions of the fellow human drivers and signaling the intentions of the car to other road users. They stress the importance of social interactions on the road: how human drivers are capable of coping in traffic with the fellow drivers by communicating and interpreting the subtle gestures in the movements of cars. Traffic, while there are humans involved, is a sociotechnical system.
Full automation and replacement of the human operators at once would be the optimal, although impossible, lowest-risk option in this domain. Those sociotechnical systems where the autonomous systems will be introduced to cooperate with humans at a fast pace or in safety-critical tasks will be the high-risk environments as there are still imperfect human operators involved in the same tasks. In these types of contexts, turbulence in cooperation due to the introduction of autonomous systems in human-operated ecosystems can be expected partly because human operators tend to satisfice , whereas autonomous systems may be designed for optimal performance. Furthermore, autonomous systems are often unaware of the limitations and constraints of human behavior and human information processing [32, 50]. This makes it impossible for them to take these into account in their own behavior and communications.
In the automotive context, the SAE-J3016  levels of vehicle automation of two to four are the challenging ones as the responsibility of driving is not fully on the driver (Levels 0-1) and not fully on the vehicle (Level 5). The shared responsibility on the control of a vehicle can lead to greater problems than giving the whole responsibility for the human (or machine) driver, if the task-relevant information and handovers are not communicated properly within a few seconds’ timeframe from the machine to the human and back again. The findings of Itoh et al.  in a study on an assistance system for emergency collision avoidance aptly illustrate that the human drivers’ choice of direction for an avoidance maneuver can well be different from the one selected by the system. Problems can be expected if the natural human tendencies and decision making processes are not taken into account in the development of these types of assistance systems. This can happen, for instance, when a system makes the decision to steer the vehicle in an emergency situation on the behalf of the driver, while the driver can still override the system by steering to another direction.
Cognitive mimetics could be utilized to solve all of these particular problems, among many other similar interaction problems in different application domains. Lake et al.  suggest that perfect autonomous vehicles should have intuitive psychology similar to humans and use this psychological reasoning in order to enable fluent cooperation in traffic with human codrivers. They argue that this kind of reasoning would be especially valuable in unexpected, challenging, and novel driving circumstances for which there is little relevant training data available. These circumstances include, for instance, navigating through highly unstructured construction zones. Another great research question for the near future is how much intelligent technologies require mimicry and understanding of human emotions in order to interact fluently with humans.
In a similar fashion, yet on a more technical level, autonomous vehicles’ machine vision systems’ classification performance could be improved by incorporating a form of intuitive physics similar to human (as discussed briefly earlier), for improved object recognition in unexpected conditions. These conditions include, for instance, poor visibility or objects disappearing behind other objects and suddenly appearing again. These kinds of anticipation capacities could provide the vehicle with a human-like ability to “see beyond the lead car.” Even if the autonomous vehicles already outperform human drivers in a great many ways, people are expecting the autonomous car to rapidly recognize, for example, a tractor-trailer that is pulling in front of the vehicle. This looming effect is something that is immediately recognizable even to a human infant. Even if autonomous vehicles may statistically decrease the overall accident risk, the autonomous vehicle should not perform worse than a human driver in any safety-critical subtask. The exact mechanisms of how AI could be given intuitive psychology and intuitive physics engines similar to humans are still unclear. Yet, as argued, these are important topics of study. There is still a great need to understand and replicate how humans mentally model situations for solving various AI-interaction problems.
Trafton et al.  provide various examples on how ACT-R/E (ACT-R/Embodied) cognitive architecture can be utilized to provide robots with a better understanding of the constraints in human information processing and behavior and, thus, to enable more fluent interactions with their human cooperators. This is a two-way street; the human cooperators could also be made aware of the limitations of machine thinking  and maybe to prepare for unexpected behaviors of the robot cooperators. As it is probable that, at least during the early stages of development, an AI system is at most capable of animal-level communication with humans, Phillips et al.  have suggested human-animal interactions as an analogy for designing human-robot interactions. This is yet another example of mimicking cognitive behavior found in nature.
Design mimetics can be conceptually divided into three levels based on the source of imitation. Firstly, biomimetics focuses on the physical and structural similarity between the source of imitation and the technical solution. Secondly, sensory-motor mimetics pay attention to the sensory-motor processes that can be found in nature for enabling technical solutions for perceptual and motoric tasks. Thirdly, the highest level of design mimetics relates to mimicking the higher cognitive processes of human experts in a task, that is, cognitive mimetics. The three-level conceptual model of design mimetics was introduced in order to clarify the difference between designing, for instance, a neural network (structural mimetics), machine vision (sensory-motor mimetics), and higher decision making processes (cognitive mimetics). All of these can be design goals for an artificially intelligent system but to imitate the structure of human vision system is far from sufficient for reaching a human level of intelligence in recognizing visual objects.
Current AI systems try to mimic intelligent human behavior on limited application areas, but in order to produce AI systems that can adapt to changes and possess generic solutions to unexpected and untrained situations, the processes behind the seemingly intelligent behaviors should better mimic the higher cognitive processes of human experts. For instance, human-to-human communication is full of unexpected and untrained situations. AI systems should manage these at a similar level to humans in order to produce as fluent human-to-AI communications as human-to-human communications as possible. These points are well known in AI literature but our critical point is that we should not stop working towards solving these problems, if we want to achieve AI that is capable of similar general intelligence as human experts are. Instead, we have suggested that more research should be devoted to what we have labeled here as cognitive mimetics.
Here, cognitive mimetics has been introduced as a hypernym for different design approaches using higher (human) cognitive processes as a source of imitation in design. The explication is important in order to make this significant approach for designing intelligent systems visible and better known as a viable path to autonomous systems with artificial general intelligence. We have shown that the approach may enable and complement the development of AI solutions that can efficiently and pleasantly understand, communicate, cooperate, and interact with their fellow human cooperators.
Conflicts of Interest
The authors declare that there are no conflicts of interest regarding the publication of this paper.
The authors want to thank Rebekah Rousi for proofreading the article. The work was partly funded by DIMECC D4Value project.
- Y. Bar-Cohen, “Biomimetics: Using nature to inspire human innovation,” Bioinspiration & Biomimetics, vol. 1, pp. 12–10, 2006.
- G. Marcus, Deep Learning: A Critical Appraisal. arXiv preprint, 2018, arXiv:1801.00631.
- L. E. Holmquist, “Intelligence on Tap: Artificial Intelligence as a New Design Material,” Interactions, vol. 24, no. 4, pp. 28–33, 2017.
- J. A. Sloboda, “Musical expertise,” in Toward a General Theory of Expertise: Prospects and Limits, K. A. Ericsson and J. Smith, Eds., pp. 153–171, Cambridge University Press, 1991.
- Y. Bar-Cohen, “Biomimetics, Using nature to inspire human innovation,” Bioinspiration & Biomimetics, vol. 1, pp. 1–12, 2006.
- O. H. Schmitt, “Some interesting and useful biomimetic transforms,” in Proceedings of the 3rd International Biophysics Congress, vol. 3, Boston, MA, 1969.
- J. F. V. Vincent, O. A. Bogatyreva, N. R. Bogatyrev, A. Bowyer, and A.-K. Pahl, “Biomimetics: its practice and theory,” Journal of the Royal Society Interface, vol. 3, no. 9, pp. 471–482, 2006.
- R. A. Jacobs and J. K. Kruschke, “Bayesian learning theory applied to human cognition,” Wiley Interdisciplinary Reviews: Cognitive Science, vol. 2, no. 1, pp. 8–21, 2011.
- W. S. McCulloch and W. Pitts, “A logical calculus of the ideas immanent in nervous activity,” Bulletin of Mathematical Biology, vol. 5, no. 4, pp. 115–133, 1943.
- M. Di Luca, S. Mintchev, G. Heitz, F. Noca, and D. Floreano, “Bioinspired morphing wings for extended flight envelope and roll control of small drones,” Interface Focus, vol. 7, no. 1, 2017.
- P. Ball, “Nature's color tricks.,” Scientific American, vol. 306, no. 5, pp. 74–79, 2012.
- R. R. Ma and A. M. Dollar, “On dexterity and dexterous manipulation,” in Proceedings of the IEEE 15th International Conference on Advanced Robotics: New Boundaries for Robotics, ICAR 2011, pp. 1–7, Estonia, June 2011.
- N. Wiener, Cybernetics: Control and Communication in the Animal and the Machine, Wiley, New York, NY, USA, 1948.
- Wikipedia, William Grey Walter, 2016, https://en.wikipedia.org/wiki/William_Grey_Walter.
- M. Wilson, “Six views of embodied cognition,” Psychonomic Bulletin & Review, vol. 9, no. 4, pp. 625–636, 2002.
- U. Neisser, Cognition and Reality: Principles and Implications of Cognitive Psychology, WH Freeman/Times Books/Henry Holt & Co, 1976.
- A. M. Turing, “Computing machinery and intelligence,” Mind, vol. 59, no. 49, pp. 433–460, 1950.
- A. M. Turing, “On computab le numbers, with an application to the entscheidungsproblem,” Proceedings of the London Mathematical Society, vol. 42, no. 2, pp. 230–265, 1936.
- C. E. Shannon, “A chess-playing machine,” Scientific American, vol. 182, no. 2, pp. 48–51, 1950.
- de Groot, Thought and Choice in Chess, The Hague: Mouton, 1965.
- A. Newell, J. C. Shaw, and H. A. Simon, “Elements of a theory of human problem solving,” Psychological Review, vol. 65, no. 3, pp. 151–166, 1958.
- A. Newell and H. A. Simon, Human Problem Solving, Prentice-Hall, Englewood Cliffs, NJ, 1972.
- IBM Systems and Technology, Watson – A System Designed for Answers: The Future of Workload Optimized Systems Design, IBM Whitepaper, 2011, http://www-03.ibm.com/marketing/br/watson/what-is-watson/a-system-designed-for-answers.html.
- D. Silver, A. Huang, C. J. Maddison et al., “Mastering the game of Go with deep neural networks and tree search,” Nature, vol. 529, no. 7587, pp. 484–489, 2016.
- J. McCarthy, Programs with Common Sense, National Physical Laboratory Teddington, UK, 1958.
- S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, Prentice-Hall, Englewood Cliffs, NJ, 1995.
- D. O. Hebb, The Organization of Behavior: A Neuropsychological Theory, New York: Pub, 1949.
- F. Rosenblatt, “The Perceptron: A probabilistic model for information storage and retrieval in the brain,” Psychological Review, vol. 65, pp. 386–407, 1956.
- J. E. Laird, The SOAR Cognitive Architecture, MIT Press, 2012.
- J. E. Laird, A. Newell, and P. S. Rosenbloom, “SOAR: An architecture for general intelligence,” Artificial Intelligence, vol. 33, no. 1, pp. 1–64, 1987.
- J. R. Anderson, D. Bothell, M. D. Byrne, S. Douglass, C. Lebiere, and Y. Qin, “An integrated theory of the mind,” Psychological Review, vol. 111, no. 4, pp. 1036–1060, 2004.
- B. M. Lake, T. D. Ullman, J. B. Tenenbaum, and S. J. Gershman, “Building machines that learn and think like people,” Behavioral and Brain Sciences, vol. 40, 2017.
- C. Gillett, “The metaphysics of realization, multiple realization and the special sciences,” Journal of Philosophy, vol. 100, pp. 591–603, 2003, http://www.jstor.org/stable/3655746.
- G. Marcus, Innateness, AlphaZero, and Artificial Intelligence, 2018, arXiv:1801.05667.
- K. W. Strabala, M. K. Lee, A. D. Dragan et al., “Towards Seamless Human-Robot Handovers,” Journal of Human-Robot Interaction, vol. 2, no. 1, pp. 112–132, 2013.
- M. C. Dorneich, E. Letsu-Dake, S. Singh, S. Scherer, L. Chamberlain, and M. Bergerman, “Mixed-Initiative Control of a Roadable Air Vehicle for Non-Pilots,” Journal of Human-Robot Interaction, vol. 4, no. 3, p. 38, 2015.
- H. Soh and Y. Demiris, “Learning Assistance by Demonstration: Smart Mobility With Shared Control and Paired Haptic Controllers,” Journal of Human-Robot Interaction, vol. 4, no. 3, p. 76, 2015.
- A. M. Andrew, “Reinforcement Learning:983Richard S. Sutton, Andrew G. Barto.,” Kybernetes, vol. 27, no. 9, pp. 1093–1096, 1998.
- H. A. Simon, “Theories of bounded rationality,” in Decision and Organization, B. McGuire and R. Radner, Eds., vol. 12, pp. 161–176, North-Holland, Amsterdam, 1972.
- D. Silver, J. Schrittwieser, K. Simonyan et al., “Mastering the game of Go without human knowledge,” Nature, vol. 550, no. 7676, pp. 354–359, 2017.
- A. Clark, “Whatever next? Predictive brains, situated agents, and the future of cognitive science,” Behavioral and Brain Sciences, vol. 36, no. 3, pp. 181–204, 2013.
- D. Hofstadter and E. Sander, Surfaces and Essences: Analogy as the Fuel and Fire of Thinking, Basic Books, 2013.
- G. A. Miller, “The cognitive revolution: A historical perspective,” Trends in Cognitive Sciences, vol. 7, no. 3, pp. 141–144, 2003.
- M. A. Boden, Artificial Intelligence and Natural Man, Basic Books, 1977.
- P. Saariluoma and M. Rauterberg, “Turing test does not work in theory but in practice,” in Proceedings of the International Conference on Artificial Intelligence (ICAI’15), pp. 433–437, WorldComp, 2015.
- J. R. Searle, “Minds, brains, and programs,” Behavioral and Brain Sciences, vol. 3, no. 3, pp. 417–424, 1980.
- S. Cass, Unthinking Machines, 2011, https://www.technologyreview.com/s/423917/unthinking-machines/.
- M. Sivak and B. Schoettle, “Should We Require Licensing Tests and Graduated Licensing for Self-Driving Vehicles?” Report No. UMTRI-2015-33, UMTRI, 2015.
- B. Brown and E. Laurier, “The Trouble with Autopilots,” in Proceedings of the the 2017 CHI Conference, pp. 416–429, Denver, Colorado, USA, May 2017.
- G. Trafton, L. Hiatt, A. Harrison, F. Tanborello, S. Khemlani, and A. Schultz, “ACT-R/E: an embodied cognitive architecture for human-robot interaction,” Journal of Human-Robot Interaction, vol. 2, no. 1, pp. 30–55, 2013.
- Society of Automotive Engineers, Taxonomy And Definitions For Terms Related To On-Road Motor Vehicle Automated Driving Systems (SAE J3016), SAE, 2014.
- M. Itoh, H. Tanaka, and T. Inagaki, “Toward Trustworthy Haptic Assistance System for Emergency Avoidance of Collision with Pedestrian,” Journal of Human-Robot Interaction, vol. 4, no. 3, p. 4, 2015.
- D. Levin, C. Harriott, N. A. Paul, T. Zheng, and J. A. Adams, “Cognitive Dissonance as a Measure of Reactions to Human-Robot Interaction,” Journal of Human-Robot Interaction, vol. 2, no. 3, 2013.
- E. K. Phillips, K. Schaefer, D. R. Billings, F. Jentsch, and P. A. Hancock, “Human-Animal Teams as an Analog for Future Human-Robot Teams: Influencing Design and Fostering Trust,” Journal of Human-Robot Interaction, vol. 5, no. 1, p. 100, 2016.
Copyright © 2018 Tuomo Kujala and Pertti Saariluoma. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.