Abstract

The nervous system makes changes in response to the continuous arrival of associative learning stimuli from the environment and executes behavioral motor activities after making predictions based on past experience. The system exhibits dynamic plasticity changes that involve the formation of the first-person internal sensations of perception, memory, and consciousness to which only the owner of the nervous system has access. These properties of natural intelligence need to be verified for their mechanism of formation using engineered systems so that a third person can access them. In the presence of a synaptic junctional delay of up to two milliseconds, we anticipate that the systems property of formation of internal sensations is likely independent of the mode of conduction along the neuronal processes. This allows testing for the formation of internal sensations using electronic circuits. The present work describes the neurobiological context for the formation of the basic units of inner sensations that occur through the reactivation of interpostsynaptic functional LINKs and its connection to motor activity. These mechanisms are translated to an analogue circuit unit for the development of robotic systems.

1. Introduction

Realistic models of the nervous system are based on known features of neurons and synapses and have been integrated into microcircuits ([1, 2] reviews [3, 4]). What additional features are needed in the transfer of natural intelligence to artificial intelligence? Nervous system combines newly arriving sensory information with that of the internal sensations of retrieved memories of the past experience to make predictions. These inner sensations guide behavioral motor actions that enable survival of the animal in the physical world. The formation of inner sensations towards which only the owner of the nervous system has access is the basis of natural intelligence. Since it is not possible to study the first-person-accessible inner sensations in biological systems, it is required to replicate the mechanism in engineered systems possibly by using silicon-based electronics. Even though some of the earlier studies were focused on replicating the nervous system’s first-person properties [5], a direct approach to test theoretically feasible mechanisms has not been carried out. In order to understand the functional emergence of the mind and its operations, it is necessary to make reasonable assumptions to fill the gaps in the experimental evidence [6] and test for novel methods to approach the first-person inner sensations. The surrogate markers in response to the internal sensations formed in the mind such as perception, memory, and consciousness are behavioral motor activities. In this regard, robotics is ideal to replicate the nervous system functions where the units that produce basic units of internal sensations can be operated to exhibit their integrated product of internal sensations that can be made to express surrogate motor outputs. The first-person feature of intrinsic motivation engaging in one’s own sake out of curiosity and exploration was examined and modeled [7]. This was followed by development of computational reinforcement learning frameworks to encompass the autonomous development of skill hierarchies [8]. Further advancement in this direction is models for developmental robotics that explores potential cognitive processes underlying intrinsic motivation [9].

Reverse engineering the nervous system requires utilizing the empirical evidence from cellular, network, and systems level to build hypotheses about how neurobiological systems use sensory information to learn and act intelligently. Using the third-person observed findings from different faculties of brain sciences such as electrophysiology, neurobiology, systems neuroscience, behavioral neuroscience, perception science, and consciousness studies, it is possible to synthesize hypotheses that can explain brain functions from a first-person frame of reference. Cellular changes during associative learning between sensory inputs of vision (light), hearing (sound), smell, taste, and touch are expected to cause changes such that at a later point of time the fastest arriving stimulus among the associatively learned stimuli can evoke the internal sensation of late-arriving or nonarriving sensations. This permits rapid assessment of the environment by the nervous system for appropriate behavioral motor responses. A universal framework is required to explain how the system can remain in a conscious state to perceive sensory information from the environment and respond to this information through motor activities based on prior learning experience. Once a hypothesis that can explain almost all the brain functions is derived, it can be followed by designing experiments to verify the formation of the first-person properties that can be accessed by a third person. A general outline of a hypothesis in this direction was made previously [10].

The specific mechanism of the formation of internal sensations should be capable of operating in unison with the known synaptic connections between the neurons. This mechanism must explain memory retrieval at physiological time-scales, changes in the formation of internal sensations with changes in the frequency of oscillating neuronal activity at certain neuronal orders (e.g., the induction of sleep), the observed relationship between memory and consciousness [1118], and the relationship between long-term potentiation (LTP) and behavioral motor activity that are currently used as surrogate markers for the formation of internal sensations of retrieved memories. In short, any mechanism involving the firing of neurons including those by the motor neurons that results in behavioral motor activity that are examined by third persons must explain how it is related to the formation of the internal sensation of higher brain functions and how it enables the system to plan and execute motor activity. With the aim to meet these criteria, the semblance hypothesis was developed [19, 20].

2. Solving for the First-Person Properties

Perception, memory, and consciousness consist of the formation of internal sensations of different complexities. The formation of the latter depends on the maintenance of an oscillatory pattern of neuronal activity at certain specific frequencies. Oscillating pattern of neuronal activities recorded using surface electroencephalogram has shown that synchronous neural oscillations are associated with cognitive processes such as memory, attention, and consciousness and in diseases of the mind [21] reviews [22, 23]. A decrease in alpha power has been linked to increasing demands of alertness and attention [24]. Theta power was shown to increase during encoding [24, 25] and theta and gamma oscillations are linked to working memory [26]. Changing their frequency during both sleep and anesthesia [27, 28] alters the formation of normal internal sensations. Synaptic transmission occurring at the synapses between the vertically arranged orders of neurons within the cortices can contribute towards the vertical component for the oscillatory pattern of firing of neurons. The horizontal component that leads to the waveform shape of the neuronal firing requires definite mechanisms. Even though gap junction proteins were thought to contribute to the lateral spread of activity, the persistence of high frequency (150 Hz) rhythms in connexin 36-deficient mice [29, 30] requires an additional mechanism to explain. Even though the presence of gap junctions between excitatory neurons was searched for, convincing evidence for their presence was not available [31]. The semblance hypothesis has proposed interpostsynaptic functional LINKs (letters are capitalized only to show its significance) as a mechanism that can provide a sufficient horizontal component at locations of convergence of inputs, some of such locations where oscillating neuronal activity is observed.

Synaptic transmission takes place unidirectionally. Synaptic vesicles in the presynaptic terminals release their contents continuously, even at rest, into the synaptic cleft (quantal release) that contributes to the miniature excitatory postsynaptic potential (mEPSP) recorded from the neuronal soma (Figure 1(a)). Activity (action potential) arriving at the excitatory presynaptic terminal leads to the generation of excitatory postsynaptic potential (EPSP) (Figure 1(b)). Continuous unidirectional neurotransmission in the form of quantal release at the synapse activating the postsynaptic terminal receptors provides the context that incidental activation of the postsynaptic terminal by artificial means can induce the cellular hallucination (semblance formation) of an activity arriving from its presynaptic terminal (Figure 2). Can the cellular hallucination occurring by activation of the postsynapse be expressed in terms of sensory stimuli? The sensory meaning imparted to the system by the cellular hallucination can be derived by extrapolating the activity from the presynaptic terminal towards the sensory receptors. The derived packet of sensory stimuli constitutes the units of virtual internal sensations (Figure 2). The artificial stimulation of sensory cortices that induce hallucinations of respective sensory modalities [32] is likely to operate by this mechanism.

The mechanism of semblance formation can support the observations that artificial stimulation of visual cortex induces visual hallucinations [34, 35]. Since visual hallucinations take place only when neuronal activity at certain neuronal orders shows an oscillatory pattern at certain frequencies [36], the cellular hallucination at the postsynapses is expected to form as a property of such systems. In a similar way, in order for internal sensations to occur in the form of semblances during higher brain functions such as perception, memory, and consciousness, it is necessary to have a mechanism to activate the postsynaptic terminal from its extrasynaptic locations. Such lateral activation can occur if the specific postsynapse where the unit of cellular hallucination is expected to be generated is LINKed to a second postsynapse. If such interpostsynaptic functional LINKs (Figure 3) are formed as a function of simultaneous activation of two abutted postsynaptic terminal membranes during associative learning, then their reactivation by the cue stimulus can induce semblances responsible for internal sensation of retrieved memories (Figure 4).

What is the likely nature of the LINK between the postsynapses? Postsynaptic membrane hemifusion [20], ephaptic transmission between the postsynaptic terminals, and a mechanism operating through extracellular matrix space are the possible candidate mechanisms. The duration for which the functional LINK is maintained can determine the duration for which it can be reactivated to induce the retrieval of memory. This can explain different types of memories based on their duration. Once newly formed, the LINK is reversible and can explain working memory. Repetitive activation or reactivation of the interpostsynaptic functional LINK by repetition of learning or related learning can result in its stabilization and can explain long-term memory. In addition to the formation of semblance, the activity arriving at the LINKed postsynapse can propagate further downstream and can lead to the firing of subthreshold activated neurons. If these neurons are motor neurons, then it can explain the initiation of spontaneous behavioral motor activity. Both innate and acquired interpostsynaptic functional LINKs are expected to carry out other higher brain functions.

The duration of time before the interpostsynaptic functional LINK reverses back to its original state determines half-life of the LINK. For example, if the mechanism operates through reversible interpostsynaptic membrane hemifusion, then insertion of transmembrane protein across the hemifused area can stabilize it until the life of the protein is over. The exact nature of the functional LINK is not known. Even though the presence of stabilized membrane hemifusion can be observed in electron microscopic pictures (Figures 2 and  4 in [37]), reversible nature of newly formed hemifused areas that can take place at very small percentage of the total area of the dendritic spines requires new technologies to track their changes in real time. Additional mechanisms for the interpostsynaptic functional LINKs are also possible including ephaptic transmission [38]. Even though structural evidence can be examined in biological systems, it will not be possible to demonstrate the first-person nature of the semblances within the biological systems. For this reason, it is necessary to replicate the mechanism in physical systems and explore ways to test for its formation.

Replicating the mechanism in a physical system is expected to be successful due to the following reasons. Nerve conduction takes place through the spread of depolarization along neuronal membranes. At the junctions between the neurons, there is a unidirectional flow of activity with a synaptic delay of 1 to 2 milliseconds. In the context of this comparatively huge delay, we anticipate that the systems property of formation of internal sensation is likely independent of the mode of conduction along the neuronal processes. Therefore, replicating the mechanism using electronic circuits by introducing a delay at the nodes between the neuronal units is expected to produce anticipated the results. The systems property of semblance formation is expected to occur if the system is made of neurons that operate with an oscillatory type of activity at certain neuronal orders mimicking the nervous system. With the advances in the field of electronics, integrated circuits built from basic units of operations can be used to test the hypothesis of formation of internal sensations. A previous work has shown how these units can be assembled to obtain systems properties [33].

It is expected that any mechanism for memory storage and retrieval should be able to explain the experimental finding of long-term potentiation (LTP) [39, 40] and the observed correlation between LTP and the behavioral motor activities that are surrogate markers for the formation of internal sensation of retrieved memories. Even though classical demonstration of LTP induction is demonstrated in the hippocampal CA3-CA1 region, LTP has been demonstrated in various locations in the nervous system. When a stimulating electrode stimulates large number of CA3 neuronal axons (Schaffer collaterals) (Figure 5(a)) whose terminals synapse with dendritic spines of the neurons of the CA1 layer, a recording electrode placed close to the main dendritic stems of the CA1 neurons records electrical changes [41]. The electrical settings of the input electrode are adjusted until the output neuron fires 50% of the time (labeled as “amplitude of 50%”). If a brief repetitive stimulation is applied initially at the Schaffer collaterals, then application of a regular stimulus is sufficient to induce a potentiated effect when recorded from the CA1 region and is called LTP. By keeping the experimental preparation viable following the initial brief repetitive stimulation, a regular stimulus applied at the Schaffer collaterals continues to induce LTP for nearly 24 hours. Later, patch clamping the postsynaptic CA1 neuronal soma was used [42, 43] to record LTP by stimulating the Schaffer collaterals. A mechanistic explanation is required to explain the rapid induction and slow weaning off of LTP during these procedures. In addition, it should be able to explain how the mechanism can substantiate the observed correlation between the experimental finding of LTP and behavioral motor activities representing the internal sensation of memory. Therefore, it is necessary to explain how the formation of reversible interpostsynaptic functional LINKs can explain LTP.

Continued incremental associative learning within the cage environment leads to the inter-LINKing of many postsynapses in the hippocampi. The group of inter-LINKed postsynapses is called an islet of LINKed postsynapses (Figure 5(a)). During LTP induction, many postsynapses get functionally LINKed due to the simultaneous activation of abutted postsynapses. Some of these LINKs is expected to occur between the islets of already LINKed postsynapses, leading to the generation of mega-islets (Figure 5(b)). Following the induction of LTP, activation of one or more postsynapses by a regular stimulus (not high frequency) can lead to the spread of depolarization between large numbers of inter-LINKed postsynapses within the megaislet. Regular stimuli can now travel through a large number of postsynapses and find more routes to reach the dendritic tree of a single CA1 neuron simultaneously (Figure 5(c)). This results in the maintenance of LTP that can be recorded by both extracellular and patch clamping methods. Membrane hemifusion between the postsynapses is a possible mechanism for the formation of interpostsynaptic functional LINK. Many studies have shown that dendritic spines (postsynapses) swell following LTP and after associative learning [4447]. As the postsynapses increase in size, their probabilities to abut each other and hemifuse increase. Attenuation of LTP was observed by injection of synaptosomal-associated protein (SNAP) inhibitors that inhibit membrane fusion, into the cell body of CA1 neuron [48]. Since (a) SNAP proteins are present within the postsynapses, (b) postsynaptic membranes are not as freely mobile as the membrane-bound spherical vesicles within the extracellular matrix volume, and (c) postsynaptic membrane curvature is less than that of the membrane-bound spherical vesicles; the hypothesized interpostsynaptic membrane hemifusion (as opposed to membrane fusion) is expected to be blocked by SNAP inhibitors. This provides further support for the proposal of reversible interpostsynaptic membrane hemifusion during LTP.

Building and assembling the basic electronic circuit units where the unit of internal sensation is expected to form requires an understanding of the known neuronal connections. The human nervous system has nearly 1011 neurons. Each neuron has a cell body and is connected with other neurons through incoming terminals (input terminal terminals, also known as postsynaptic terminals or postsynapses or dendritic spines) and outgoing terminals (presynaptic terminals or presynapses) (Figure 6). The number of these terminals varies widely among different neurons ranging from one to tens of thousands [49]. Synapses are the junctions between the output terminals (presynaptic terminals) of a neuron and usually one of the input terminals (postsynaptic terminals) of the next order neuron. Nerve conduction is transmitted from one neuron to other neurons through the synapses. In excitatory neurons, synaptic activity produces an excitatory postsynaptic potential (EPSP) at one of the postsynaptic terminals of the neuron and it propagates towards the latter’s axonal hillock. For the purpose of this work, only excitatory synapses are used since inhibitory neurons and glial cells can be incorporated into the main framework for fine regulation at various neuronal orders. When a threshold number of EPSPs (nearly forty) arrive (Figure 7 in [50]), they can summate spatially or temporally to induce an action potential, by an “all or none” principle. When the sum of the EPSPs is less than the threshold, it will fall short of inducing an action potential. Even if the sum of EPSPs is much higher than the threshold, it will only induce the same action potential. Once elicited, the action potential propagates towards all the output terminals of the neuron.

Interpostsynaptic functional LINK is modeled using an electronic circuit with an aim to replicate the hypothesized changes during associative learning and to demonstrate the formation of the internal sensation of memory at the time of memory retrieval. Representative diagrams showing the interpostsynaptic functional LINK and the components of the corresponding electronic circuit are shown in Figures 7(a) and 7(b).

A detailed electronic circuit is shown in Figures 8(a) and 8(b). The input terminals are represented by voltage inputs numbered from , , , , and to the neuron NA and , , , , and to the neuron NC. Neurons have varying number of terminals ranging from one, at some of the early orders of neurons in visual pathway, to nearly 2.4 to 5.2 × 104 input terminals (postsynaptic terminals receiving EPSPs) to a neuron in higher neuronal orders [49]. These neuronal inputs are represented by five input terminals to each neuron NA and NC. When an excitatory synapse is activated, it induces EPSP at the postsynaptic terminal. A regulated direct current power supply is used to provide constant voltage to the five input terminals , , , , and of the neuron NA and , , , , and of the neuron NC. ,   and , are representative resistor sets shown at each one of the input terminals of the neurons NA and NC whose values can be adjusted to determine the voltage at each input. The origin of action potential generation is modeled using the voltage comparator OpAmps marked as NA and NC. Resistors and form a voltage divider that determine − value to the comparator. The resistor values are set up such that when the number of inputs to the + of the comparator is less than two, no output (action potential) is generated. If the number of inputs is two or more than two, an output is generated. Even if NA or NC receives all five inputs, they elicit only one output (action potential). This makes the output function of the voltage comparator OpAmp similar to the functioning of “all or none” phenomenon of action potential generation of a neuron:

This is represented by the of the comparators as follows:

Before an associative learning event, independent activation of individual neurons NA and NC results in the generation of independent activity at their corresponding postsynaptic dendritic terminals and that are shown as the outputs of the circuit unit. During associative learning, when neurons NA and NC are activated together, it results in the formation of an interpostsynaptic functional LINK. After associative learning, the arrival of activity through one of the neuronal pathways results in the reactivation of the interpostsynaptic functional LINK. This results in the flow of activity through both the postsynaptic dendrites and .

The synapse [] is represented by the diodes ,  , and and the changes taking place between them. The second synapse [] is represented by the set of diodes , , and and the changes taking place between them. Changes taking place at these diodes representing the synapse include unidirectional synaptic transmission, a synaptic delay of 1 to 2 milliseconds, and the potential changes resulting from quantal release from the presynaptic terminal to the synaptic cleft. A synaptic delay of 1 to 2 milliseconds is achieved in the synapses [] and [] by using the resistor capacitor sets , and , , respectively. The changes in the potential difference between the plates of capacitors and through the resistors and , respectively, are given by the formula , where = voltage on the capacitor at time ; = voltage from or ; = initial voltage on the capacitor; = charging or discharging time; = resistance; = capacitance. Synaptic delay of the circuit depends on the time needed to charge the capacitor located at the presynaptic terminal. The cathodes of the diodes and represent the postsynaptic terminal. Neurons are represented by the comparators NA and NC, respectively. When NA and NC are activated, all their output terminals (presynaptic or axonal terminals) receive voltage. Pr and Pr are the two presynaptic terminals, respectively, of the neurons NA and NC. Pr is represented by the combination of diodes , and the anode of the diode . Pr is represented by the combination of diodes , and the anode of the diode . Pos and Pos are the two postsynaptic terminals and are represented by the cathodes of the diodes and . When activity reaches a synapse, it elicits an EPSP at the postsynaptic terminal (input terminal) of the next neuron.

The synapses at the output terminals (axonal terminals) Pr and Pr of neurons NA and NC, respectively, are abutted to each other at various locations in the nervous system where inputs converge. When these synapses are activated simultaneously during associative learning, a functional LINK is formed between their respective postsynaptic terminals Pos and Pos. In the electronic circuit, this is represented by the formation of a reversible LINK between the cathodes of the diodes and . The interpostsynaptic functional LINK [] is primarily represented by the operation of the latch marked Latch1. When both neurons NA and NC are activated together, the output terminals are functionally LINKed by the arrival of sufficient activity at the AND gate AND1 and the latch marked Latch1. Once triggered, Latch1 continuously provides output. This is equivalent to the formation and maintenance of an interpostsynaptic functional LINK as long as input arrives at the Pos. Once arrival of the input at Pos stops, the interpostsynaptic functional LINK remains in a reactivatible state following an associative learning event. The strength of the interpostsynaptic functional LINK is increased by mechanisms that can stabilize it. As the stability increases, the duration of memory storage increases. The reset function of the Latch1 is controlled by the timer marked Timer1 that determines the duration of the function of the latch. This guides the adjustment of the duration of operation of the system. Once triggered, the constant output from the Latch1 continuously reaches one of the inputs to the second AND gate AND2. At a later time, the arrival of sufficient stimuli capable of activating either one of the neurons NA or NC through the OR gate OR1 provides the second input to activate AND2. Activation of the AND2 represents the reactivation of the interpostsynaptic functional LINK.

When neuron NA is activated following associative learning, it reactivates the interpostsynaptic functional LINK [] that was formed during associative learning and the voltage reaches the cathode of the diode that represents the functionally LINKed postsynaptic terminal of neuron NC. This arrival of activity at the cathode of diode in the absence of the arrival of activity from its anode is expected to produce a cellular hallucination that it is being activated by the anode of the diode as a systems property. Activating a postsynaptic terminal without arrival of activity from its corresponding presynaptic terminal is expected to form basic units of internal sensations as a systems property when a large number of units are arranged similar to arrangements found in the nervous systems of different animal species.

Normal synaptic transmission takes place through the release of neurotransmitter from a large number of synaptic vesicles from the presynaptic terminal only at the time of arrival of neuronal activity. In contrast, quantal release of neurotransmitters from single vesicles from the presynaptic terminal continuously elicits miniature potentials at the postsynaptic terminal even at rest. These contribute towards the recordable miniature EPSPs (mEPSPs) at the soma. The voltage generated by quantal release at rest generating mEPSP is substantially lower than the voltage induced by EPSP generated by the arrival of an action potential at the presynaptic terminal:miniature potentials at the postsynaptic terminal induced by the release of contents of a single synaptic vesicle EPSP at the postsynaptic terminal induced by the arrival of action potential at the presynaptic terminal

The voltage source for mEPSP is represented as follows. Timer IC marked as S1 provides pulsed intermittent miniature voltages through the sets of diode and resistor and and and . The miniature voltages at the anode of the diodes and continuously cross to the cathode side that represents the postsynaptic terminals of the synapses. Due to the miniature nature of these voltages, they do not contribute towards the activation of the neurons in the next neuronal order. The continuous arrival of miniature voltage at the cathodes (that represents the postsynaptic terminal) of the diodes (that represent the synapse) and even at rest is a unique feature of the system. This context is essential for the formation of cellular hallucination of arrival of activity from corresponding presynaptic terminal when activity arrives at the postsynaptic terminal through the interpostsynaptic functional LINK.

Additional presynaptic terminals from the neurons NA and NC are also shown and are represented by and from the buffers and , respectively. Formation of interpostsynaptic functional LINKs at the postsynaptic terminals of the synapses that are formed at the additional output terminals enables this electronic circuit unit to be expanded and interconnected with large number of similar units. Following associative learning the interpostsynaptic functional LINK remains active, which is represented by the state of the latch marked as Latch1 to remain as latched. At this time arrival of activity through either one of the neurons NA or NB activates the latches marked Latch2 and Latch3. This is facilitated through the AND gate AND5. The arrival of activity through either one of the inputs activates Latch1 and provides the second input to the AND gates AND3 and AND4. This part of the circuit provides control of the duration of activation of the functionally LINKed postsynaptic terminals. Arrival of activity through either one of the inputs activates the latch marked Latch2 and provides the second input to the OR gate OR5. This part of the circuit provides output from the circuit unit. When the AND gate AND2 is activated, it simultaneously provides output from the unit through both the outputs and . Note that by using the buffers and , steady voltage is made to arrive at the postsynaptic dendrites and . The outputs at and are essential for downstream neuronal activation.

When neurons NA and NC are activated simultaneously, an interpostsynaptic functional LINK [] is formed. When this functional LINK is not reactivated, it remains in a dormant state for a certain period of time depending on its life-span. The latch marked Latch1 represents the dormant interpostsynaptic functional LINK. Following associative learning, if sensory inputs do not arrive through the neurons NA or NC, then the OR gate OR2 gets closed. This activates the inverter IN1, which in turn activates three downstream timers Timer1, Timer2, and Timer3. This event controls three downstream events. (1) Triggering the Timer1 controls the duration of functioning of Latch1, which represents the interpostsynaptic functional LINK. (2) Triggering Timer2 controls the duration of functioning of Latch2 and determines the duration of activation of the postsynaptic terminals that are represented by the cathodes of the diodes and . (3) Triggering of Timer3 controls the duration of functioning of Latch3 that determines the duration of activity at the postsynaptic dendrites and . Latches marked Latch2 and Latch3 are made to function continuously through the arrival of activity along one of the inputs only when the Latch1 that represents the interpostsynaptic functional LINK remains activated. If the interpostsynaptic functional LINK represented by Latch1 remains active, then the arrival of activity at any one of the inputs enables the activation of the cathode of the diode that represents the functionally LINKed postsynaptic terminal. Thus, the duration of the interpostsynaptic functional LINKs, the duration of reactivation of the functionally LINKed postsynaptic terminals, and the duration of activation of dendrites of the functionally LINKed postsynaptic terminals are functions initiated by the stoppage of arrival of activity to both the diodes and that represent synapses of the functionally LINKed postsynaptic terminals.

From the AND gate AND2, activity reaches the postsynaptic terminals of both synapses. These take place through the AND gate AND3 and diode towards the postsynaptic terminal of the synapse [] represented by the cathode of the diode and the AND gate AND4 and diode towards the postsynaptic terminal of the synapse [] represented by the cathode of the diode . During memory retrieval, the activation of either one of the input neurons NA or NC by the cue stimulus leads to the reactivation of the interpostsynaptic functional LINK [] that results in the arrival of activity at the cathode (postsynaptic terminal) side of the functionally LINKed postsynaptic terminals or .

This circuit allows maintaining the interpostsynaptic functional LINK until its life-span is over, even in the absence of arrival of continuous activity for continuous activation of either one of the LINKed postsynaptic terminals. Similarly, even in the absence of neuronal output from the unit, this circuit maintains interpostsynaptic functional LINKs until its life-span is over. The life-span of the interpostsynaptic functional LINK is achieved in the circuit through the set time of Timer1. The timers marked Timer2 and Timer3 are set for shorter periods of time compared to Timer1. After the life-span of the interpostsynaptic functional LINK is over, the arrival of activity through either of the synapses and provides outputs only through their corresponding outputs and , respectively, as occurred before associative learning. The arrangements of the OR gates OR3, OR4, and OR5 and the AND gates AND6 and AND7 enable the circuit to accomplish these functions.

The functional LINK between the postsynaptic terminals is built using electronic circuits in order to provide all its functional attributes. This consists of (a) inputs reaching the neurons triggering action potential when summated EPSPs surpass a threshold value, (b) action potentials traversing to the output terminals (presynaptic terminals) activating the synapses at the their terminals, and (c) activity reaching the postsynaptic terminals. When the simultaneous activation of closely located postsynaptic terminals of different neurons takes place, it induces a functional LINK between those postsynaptic terminals. The formed interpostsynaptic functional LINK is reactivated by activity arriving at either one of the postsynaptic terminals from their respective inputs. Each interpostsynaptic functional LINK has a specific life-span. This is represented by a time-period during which an interpostsynaptic functional LINK becomes reactivatible. This reactivation of the interpostsynaptic functional LINK results in the spread of activity towards the postsynaptic terminal of the second synapse that already was functionally LINKed during a previous associative learning event.

4.1. Functional States of the Interpostsynaptic Functional LINK

The functioning of the electronic circuit can be explained as occurring in four states (Figure 9). At the resting state, the activation of neurons NA or NC results in independent outputs from their corresponding output terminals and . The second state is the formation of the functional LINK between the postsynaptic terminals during associative learning, which is represented by the activation of the latch marked as Latch1. The third state occurs when activity stops arriving at both the inputs. This leads to the activation of three timers, which in turn controls the life-span of the interpostsynaptic functional LINK, duration of activation of the LINKed postsynaptic terminals, and activity along the LINKed postsynaptic dendrites towards the cell bodies of their neurons. The fourth state is the reactivation of the interpostsynaptic functional LINK when activity arrives at either one of the postsynaptic terminals that participated in the formation of the interpostsynaptic functional LINK, if the functional LINK remains reactivatible (before its life-span is over). This reactivation of the interpostsynaptic functional LINK activates the LINKed postsynaptic terminal resulting in semblance formation and also in the spread of activity along the dendrite of the LINKed postsynaptic terminal. The duration of the reactivatible state of the functionally LINKed postsynaptic terminal is dependent on the duration of existence of the interpostsynaptic functional LINK. The life-span of the interpostsynaptic functional LINK, its existence in a reactivatible state, and the duration of activation of the functionally LINKed postsynaptic terminal are determined by the preset values of the timers Timer1, Timer2, and Timer3, respectively.

4.2. Assembling the Units to Form an Artificial Nervous System

The functional units must be arranged in a similar fashion as found in different nervous systems. A detailed method by which these units can be arranged was explained previously [33]. Apart from the general principles detailed in the above work, it is necessary to provide specific arrangements of the neuronal connections. For example, at the sensory cortices where the sensory inputs arrive, it may be necessary to arrange the inputs in minicolumns for perception. Even though the cortical columns have a network of regulated operation [51], one can begin assembling the units without complex regulatory paths. Initial experiments need only to focus on the general layout of the circuit units. It is expected that the outputs from the primary sensory cortices will converge at locations of convergence of sensory inputs, for example, the hippocampus. At the hippocampus and cortex where large number of interpostsynaptic functional LINKs are expected to be present, the horizontal component provided by the interpostsynaptic functional LINKs can contribute towards the oscillating neuronal activity in a group of neurons. When assembled in large numbers mimicking the nervous system, it is anticipated to have a region similar to the hippocampus when inputs from various sensory systems converge. The system should continuously receive sensory stimuli similar to the background stimuli that are obtained from breathing movements, blood flow, and cutaneous stimulation. The present circuit manually adjusts the timers that control the latches to demonstrate the period during which interpostsynaptic functional LINKs remain reactivatible and also its life-span. In robotic systems, these timers can be automated to operate proportional to the number and strength of the reactivations of the interpostsynaptic functional LINKs.

Convergence of sensory inputs within the temporal lobe can result in formation of large number of interpostsynaptic functional LINKs during associative learning. Depending on the number of inputs converging to an area, it should be possible to induce changes similar to LTP as described in Figure 5 and occlusion experiments carried out in animals [52]. Propagation of activities to further higher neuronal orders can result in sparse convergence that can provide specificity in formation of specific memories. There are a number of areas in the temporal lobe neocortex where multisensory convergence occurs as indicated by the presence of neurons in this area responding to different sensory modalities [53]. This has led to demonstration of different phenomenon such as what is seen affects what is heard [54] and perception of auditory syllables that are influenced by what is seen [55].

4.3. Obtaining Readouts of Internal Sensations

An objective third-person assessment of memories can be best carried out if readouts of the internal sensations can be obtained. This can then be matched with the behavioral motor outputs that we presently use as the surrogate marker for internal sensations. The first-person property of internal sensations expected to form within the machines can be best approached by the following steps [33]. The core principle should be based on deriving the relationship between how a system perceives an object and how that system later retrieves the internal sensations of memories of the object when exposed to a cue stimulus. It involves discovering the computational algorithm using all the semblions at the location of reactivation of interpostsynaptic functional LINKs to match the sensory stimuli that arrived from the item before learning, whose memories are currently being retrieved. When building robotic systems, the first step is to identify the locations of interpostsynaptic functional LINKs that are reactivated in the presence of the cue stimulus. The second step is to find all the possible semblions that can be formed at the functionally LINKed postsynapses that are activated during the reactivation of the interpostsynaptic functional LINKs. The third step is to find an algorithm to compute the correct set of semblions to obtain the net semblance that matches the item whose memories are retrieved.

4.4. Motor Outputs from Robotic Systems

Along with the steps mentioned in the above session, the net semblance is expected to match with the activation of motor neurons that result in behavioral motor activity. In order to identify this, it is required to examine which motor neurons are receiving baseline net EPSP (secondary to oscillating neuronal activity), less than the required threshold EPSP for eliciting action potential. Neurons that are kept inhibited by activities of inhibitory interneurons are also examined. The details of the mechanism that connects the formation of internal sensation and behavioral motor outputs were described previously [20]. A combination of computations for matching semblances along with motor activity can be programmed in robotic systems. This requires adjusting the circuit parameters by methods of trial and error. As it takes many years, following birth, for a human nervous system to mature and to produce expected behavioral motor activity, a given robotic system is expected to require large number of initial associative learning steps before it can provide meaningful outputs. Once the optimal maturation of a given system is achieved, the emerging rules of connectivity can guide building more complex systems faster. In this regard, initial tests need to be carried out to replicate simple nervous systems capable of providing robust motor responses.

5. Discussion

Various neural circuit models have been proposed in the past. Completely recurrent neural network model with adaptive synapses [56], item-and-order working memory model that explains how successive items presented through time are stored in working memory as a temporal pattern of activity across working memory cells [57], and winner-take-all models with both theoretical [58] and laboratory observations [59] have been examined. However, these models have not explained the nature of the internal sensations being created within them. The present circuit provides provision for the formation of inner sensations expected to form at specific oscillatory firing frequencies of neurons at certain neuronal orders. By varying the frequencies, the nature of the internal sensations can be changed and eventually are expected to stop during sleep. As the proposed model is a dynamic system in principle, stability is a critical issue. The nonlinearity in the model implies that stability of all parts of the circuit may not result in the stability of the overall system. Moreover, continuous formation of new neurons at certain orders of neurons of the circuitry can bring additional instability. Three factors are expected to prevent instability. First, since the firing of neurons takes place by “all or none” phenomena, a large number of inputs that arrive in surplus of the threshold inputs do not have an effect on neuronal firing. This is represented by the operation of the comparator in the electronic circuit. Secondly, at locations where the inputs converge, the lateral spread of activity through the interpostsynaptic functional LINKs is expected to contribute to the horizontal vector which along with the vertical component of synaptic neurotransmission leads to oscillating pattern of neuronal activity. Thirdly, the introduction of inhibitory interneurons into the circuit is expected to equilibrate the circuit operations. Further work is needed to find the region of attraction at the equilibrium point for the resulting nonlinear dynamical system of a given neuronal circuitry at specific time-points. The outputs from the circuit units can be used to provide additional EPSPs to subthreshold activated motor neurons to execute behavioral motor activity. It may become feasible to build independent modules operating in a distributed manner controlling multiple redundant manipulators for generating collective behavioral motor responses as explained in the previous work [60]. The sensations resulting from motor movements are expected to provide feedback inputs to the system.

6. Conclusion

The present work has provided a modifiable analogue circuit that can operate similar to the functions of the hypothetical interpostsynaptic functional LINK. These units can be assembled in multiples to build artificial robotic systems with the expectation that the first-person properties of nervous system function will become empirically available along with matching surrogate behavioral motor activities. The expectation of the formation of internal sensation (that cannot be sensed by a third person) concurrent with surrogate motor activity (that can be sensed by a third person) may be compared to the formation of electromagnetism (that cannot be sensed by us) concurrent with the surrogate deflection of a conductor (that can be sensed by us) carrying current in a magnetic field. The circuit features from which the formation of semblances is expected can be replicated using electronic circuits along with in silico software simulations for understanding the rules for the integration of semblances. Scaling up of the present circuit model can lead to the development of robotic systems, which are expected to continuously learn from uncertain inputs from natural scenarios, show behavioral motor activities, and respond to both immediate and delayed rewards. Variations are expected in the pattern of arrangement of the same basic units among the already catalogued 1.12 million animal species along with predicted million uncatalogued animal species on earth [61]. Each species has evolved neuronal circuits to make optimal internal sensations of predictions capable of executing the required behavioral motor activity that enables their survival. The large number of animal species increases the probability that trial and error methods of assembly of the electronic circuit units will lead to the generation of systems that mimic one of their nervous systems.

Abbreviations

AND:AND logic gate
DC:Direct current
Dn:Dendrite
EPSP:Excitatory postsynaptic potential
IC:Integrated circuit
IPS:Interpostsynaptic location
LINK:Interpostsynaptic functional link
LTP:Long-term potentiation
mEPSP:Miniature excitatory postsynaptic potential
NA:Neuron A
NC:Neuron C
OR:OR logic gate
Post:Postsynaptic terminal
Postsynapse:Postsynaptic terminal (dendritic spine) or input terminal
Pre:Presynaptic terminal
Presynapse:Presynaptic terminal (axonal terminal) or output terminal
:Input voltage
:Output voltage.

Conflict of Interests

U.S. patent application 14/068,835 pertains to this work.

Acknowledgments

The author acknowledges the support from Neurosearch Center, Toronto. The author thanks the editor and the reviewers for their helpful comments.