Tensor network theory

For the tensor network theory used in quantum physics, see matrix product state

Tensor network theory is a theory of brain function (particularly that of the cerebellum) that provides a mathematical model of the transformation of sensory space-time coordinates into motor coordinates and vice versa by cerebellar neuronal networks. The theory was developed by Andras Pellionisz and Rodolfo Llinas in the 1980s as a geometrization of brain function (especially of the central nervous system) using tensors. [1][2]

Metric tensor that transforms input covariant tensors into output contravariant tensors. These tensors can be used to mathematically describe cerebellar neuronal network activities in the central nervous system.

History

Neuronal network schematic. The sensory inputs get transformed by the hidden layer representing the central nervous system which in turn outputs a motor response.

Geometrization movement of the mid-20th century

The mid-20th century saw a concerted movement to quantify and provide geometric models for various fields of science, including biology and physics.[3][4][5] The geometrization of biology began in the 1950s in an effort to reduce concepts and principles of biology down into concepts of geometry similar to what was done in physics in the decades before.[3] In fact, much of the geometrization that took place in the field of biology took its cues from the geometrization of contemporary physics.[6] One major achievement in general relativity was the geometrization of gravitation.[6] This allowed the trajectories of objects to be modeled as geodesic curves (or optimal paths) in a Riemannian space manifold.[6] During the 1980s, the field of theoretical physics also witnessed an outburst of geometrization activity in parallel with the development of the Unified Field Theory, the Theory of Everything, and the similar Grand Unified Theory, all of which attempted to explain connections between known physical phenomena.[7]

The geometrization of biology in parallel with the geometrization of physics covered a multitude of fields, including populations, disease outbreaks, and evolution, and continues to be an active field of research even today.[8][9] By developing geometric models of populations and disease outbreaks, it is possible to predict the extent of the epidemic and allow public health officials and medical professionals to control disease outbreaks and better prepare for future epidemics.[8] Likewise, there is work being done to develop geometric models for the evolutionary process of species in order to study the process of evolution, the space of morphological properties, the diversity of forms and spontaneous changes and mutations.[9]

Geometrization of the brain and tensor network theory

Around the same time as all of the developments in the geometrization of biology and physics, some headway was made in the geometrization of neuroscience. At the time, it became more and more necessary for brain functions to be quantified in order to study them more rigorously. Much of the progress can be attributed to the work of Pellionisz and Llinas and their associates who developed the tensor network theory in order to give researchers a means to quantify and model central nervous system activities.[1][2]

In 1980, Pellionisz and Llinas introduced their tensor network theory to describe the behavior of the cerebellum in transforming afferent sensory inputs into efferent motor outputs.[1] They proposed that intrinsic multidimensional central nervous system space could be described and modeled by an extrinsic network of tensors that together describe the behavior of the central nervous system.[1] By treating the brain as a "geometrical object" and assuming that (1) neuronal network activity is vectorial and (2) that the networks themselves are organized tensorially, brain function could be quantified and described simply as a network of tensors.[1][2]

Example

Six rotational axes about which the extraocular muscles turn the eye and the three rotational axes about which the vestibular semicircular canals measure head-movement. According to tensor network theory, a metric tensor can be determined to connect the two coordinate systems.

Vestibulo-ocular reflex

In 1986, Pellionisz described the geometrization of the "three-neuron vestibulo-ocular reflex arc" in a cat using tensor network theory.[10] The "three-neuron vestibulo-ocular reflex arc" is named for the three neuron circuit the comprises the arc. Sensory input into the vestibular system (angular acceleration of the head) is first received by the primary vestibular neurons which subsequently synapse onto secondary vestibular neurons.[10] These secondary neurons carry out much of the signal processing and produce the efferent signal heading for the oculomotor neurons.[10] Prior to the publishing of this paper, there had been no quantitative model to describe this "classic example of a basic sensorimotor transformation in the central nervous system" which is precisely what tensor network theory had been developed to model.[10]

Here, Pellionisz described the analysis of the sensory input into the vestibular canals as the covariant vector component of tensor network theory. Likewise, the synthesized motor response (reflexive eye movement) is described as the contravariant vector component of the theory. By calculating the neuronal network transformations between the sensory input into the vestibular system and the subsequent motor response, a metric tensor representing the neuronal network was calculated.[10]

The resulting metric tensor allowed for accurate predictions of the neuronal connections between the three intrinsically orthogonal vestibular canals and the six extraocular muscles that control the movement of the eye.[10]

Applications

Neural Networks and Artificial Intelligence

Neural networks modeled after the activities of the central nervous system have allowed researchers to solve problems impossible to solve by other means. Artificial neural networks are now being applied in various applications to further research in other fields. One notable non-biological application of the tensor network theory was the simulated automated landing of a damaged F-15 fighter jet on one wing using a "Transputer parallel computer neural network".[11] The fighter jet's sensors fed information into the flight computer which in turn transformed that information into commands to control the plane's wing-flaps and ailerons to achieve a stable touchdown. This was synonymous to sensory inputs from the body being transformed into motor outputs by the cerebellum. The flight computer's calculations and behavior was modeled as a metric tensor taking the covariant sensor readings and transforming it into contravariant commands to control aircraft hardware.[11] Other applications include teaching computers how to recognize handwriting, speech, and traffic signs by using deep learning which utilizes artificial neural networks.[12][13]

References

  1. 1 2 3 4 5 Pellionisz, A., Llinás, R. (1980). "Tensorial Approach To The Geometry Of Brain Function: Cerebellar Coordination Via A Metric Tensor". Neuroscience 5 (7): 1125––1136. doi:10.1016/0306-4522(80)90191-8. PMID 6967569.
  2. 1 2 3 Pellionisz, A., Llinás, R. (1985). "Tensor Network Theory Of The Metaorganization Of Functional Geometries In The Central Nervous System". Neuroscience 16 (2): 245–273. doi:10.1016/0306-4522(85)90001-6. PMID 4080158.
  3. 1 2 Rashevsky, N (1956). "The Geometrization of Biology". Bulletin of Mathematical Biophysics 18: 31–54. doi:10.1007/bf02477842.
  4. ↑ Palais, Richard (1981). "The Geometrization of Physics". Lecture Notes in Mathematics: 1–107.
  5. ↑ Mallios, Anastasios (August 2006). "Geometry and physics of today". International Journal of Theoretical Physics 45 (8): 1552–1588. doi:10.1007/s10773-006-9130-3.
  6. 1 2 3 Bailly, Francis (2011). Mathematics and the Natural Sciences: The Physical Singularity of Life. Imperial College Press. ISBN 978-1848166936.
  7. ↑ KALINOWSKI, M (1988). "The Program of Geometrization of Physics: Some Philosophical Remarks". Synthese 77: 129–138. doi:10.1007/bf00869432.
  8. 1 2 Kahil, M (2011). "Geometrization of Some Epidemic Models". Wseas Transactions on Mathematics 10 (12): 454–462.
  9. 1 2 Nalimov, W (2011). "Geometrization of biological ideas: probablistic model of evolution". Zhurnal Obshchei Biologii 62 (5): 437–448.
  10. 1 2 3 4 5 6 Pellionisz, Andras; Werner Graf (October 1986). "Tensor Network Model of the "Three-Neuron Vestibulo-Ocular Reflex-Arc" in Cat". Journal of Theoretical Neurobiology 5: 127–151.
  11. 1 2 Pellionisz, Andras (1995). "Flight Control by Neural Nets: A Challenge to Government/Industry/Academia". International Conference on Artificial Neural Networks.
  12. ↑ Schmidhuber, Juergen. "How bio-inspired deep learning keeps winning competitions". Kurzweil Accelerating Intelligence. KirzweilAINetwork. Retrieved November 17, 2013.
  13. ↑ Ciresan, D.; U. Meier; J. Masci; J. Schmidhuber (2012). "Multi-Column Deep Neural Networks for Traffic Sign Classification". Neural Networks 32: 333–338. doi:10.1016/j.neunet.2012.02.023.

External links

This article is issued from Wikipedia - version of the Saturday, January 23, 2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.