Brain-reading

Brain-reading uses the responses of multiple voxels in the brain evoked by stimulus then detected by fMRI in order to decode the original stimulus. Brain reading studies differ in the type of decoding (i.e. classification, identification and reconstruction) employed, the target (i.e. decoding visual patterns, auditory patterns, cognitive states), and the decoding algorithms (linear classification, nonlinear classification, direct reconstruction, Bayesian reconstruction, etc.) employed.

Classification

In classification, a pattern of activity across multiple voxels is used to determine the particular class from which the stimulus was drawn.[1] Many studies have classified visual stimuli, but this approach has also been used to classify cognitive states.

Reconstruction

In reconstruction brain reading the aim is to create a literal picture of the image that was presented. Early studies used voxels from early visual cortex areas (V1, V2, and V3) to reconstruct geometric stimuli made up of flickering checkerboard patterns.[2][3]

Natural images

More recent studies used voxels from early and anterior visual cortex areas forward of them (visual areas V3A, V3B, V4, and the lateral occipital) together with Bayesian inference techniques to reconstruct complex natural images. This brain reading approach uses three components:[4] A structural encoding model that characterizes responses in early visual areas; a semantic encoding model that characterizes responses in anterior visual areas; and a Bayseian prior that describes the distribution of structural and semantic scene statistics.[4]

Experimentally the procedure is for subjects to view 1750 black and white natural images that are correlated with voxel activation in their brains. Then subjects viewed another 120 novel target images, and information from the earlier scans is used reconstruct them. Natural images used include pictures of a seaside cafe and harbor, performers on a stage, and dense foliage.[4]

Other types

It is possible to track which of two forms of rivalrous binocular illusions a person was subjectively experiencing from fMRI signals.[5] The category of event which a person freely recalls can be identified from fMRI before they say what they remembered.[6] Statistical analysis of EEG brainwaves has been claimed to allow the recognition of phonemes,[7] and at a 60% to 75% level color and visual shape words.[8] It has also been shown that brain-reading can be achieved in a complex virtual environment.[9]

Accuracy

Brain-reading accuracy is increasing steadily as the quality of the data and the complexity of the decoding algorithms improve. In one recent experiment it was possible to identify which single image was being seen from a set of 120.[10] In another it was possible to correctly identify 90% of the time which of two categories the stimulus came and the specific semantic category (out of 23) of the target image 40% of the time.[4]

Limitations

It has been noted that so far brain reading is limited. "In practice, exact reconstructions are impossible to achieve by any reconstruction algorithm on the basis of brain activity signals acquired by fMRI. This is because all reconstructions will inevitably be limited by inaccuracies in the encoding models and noise in the measured signals. Our results demonstrate that the natural image prior is a powerful (if unconventional) tool for mitigating the effects of these fundamental limitations. A natural image prior with only six million images is sufficient to produce reconstructions that are structurally and semantically similar to a target image."[4]

Applications

Brain reading has been suggested as an alternative to polygraph machines as a form of lie detection.[11] One neuroimaging method that has been proposed as a lie detector is EEG "brain-fingerprinting", in which event related potentials are supposedly used to determine whether a stimulus is familiar or unfamiliar.[12] The inventor of brain fingerprinting, Lawrence Farwell, has attempted to demonstrate its use in a legal case, Harrington v. State of Iowa, although the state objected on the basis that the probes used by Farwell were too general for familiarity or unfamiliarity with them to prove innocence.[11] Another alternative to polygraph machines is Blood Oxygenated Level Dependent functional MRI technology (BOLD fMRI). This technique involves the interpretation of the local change in the concentration of oxygenated hemoglobin in the brain, although the relationship between this blood flow and neural activity is not yet completely understood.[11]

A number of concerns have been raised about the accuracy and ethical implications of brain reading for this purpose. Laboratory studies have found rates of accuracy of up to 85%; however, there are concerns about what this means for false positive results among non-criminal populations: "If the prevalence of "prevaricators" in the group being examined is low, the test will yield far more false-positive than true-positive results; about one person in five will be incorrectly identified by the test."[11] Ethical problems involved in the use of brain reading as lie detection include misapplications due to adoption of the technology before its reliability and validity can be properly assessed and due to misunderstanding of the technology, and privacy concerns due to unprecedented access to individual’s private thoughts.[11] However, it has been noted that the use of polygraph lie detection carries similar concerns about the reliability of the results[11] and violation of privacy.[13]

Brain-reading has also been proposed as a method of improving human-machine interfaces, by the use of EEG to detect relevant brain states of a human.[14] In recent years, there has been a rapid increase in patents for technology involved in reading brainwaves, rising from fewer than 400 from 2009-2012 to 1600 in 2014.[15] These include proposed ways to control video games via brain waves and “neuro-marketing” to determine someone’s thoughts about a new product or advertisement.

See also

References

  1. ↑ Kamitani, Yukiyasu; Tong, Frank (2005). "Decoding the visual and subjective contents of the human brain". Nature Neuroscience 8 (5): 679–85. doi:10.1038/nn1444. PMC 1808230. PMID 15852014.
  2. ↑ Miyawaki, Y; Uchida, H; Yamashita, O; Sato, M; Morito, Y; Tanabe, H; Sadato, N; Kamitani, Y (2008). "Visual Image Reconstruction from Human Brain Activity using a Combination of Multiscale Local Image Decoders". Neuron 60 (5): 915–29. doi:10.1016/j.neuron.2008.11.004. PMID 19081384.
  3. ↑ Thirion, Bertrand; Duchesnay, Edouard; Hubbard, Edward; Dubois, Jessica; Poline, Jean-Baptiste; Lebihan, Denis; Dehaene, Stanislas (2006). "Inverse retinotopy: Inferring the visual content of images from brain activation patterns". NeuroImage 33 (4): 1104–16. doi:10.1016/j.neuroimage.2006.06.062. PMID 17029988.
  4. 1 2 3 4 5 Naselaris, Thomas; Prenger, Ryan J.; Kay, Kendrick N.; Oliver, Michael; Gallant, Jack L. (2009). "Bayesian Reconstruction of Natural Images from Human Brain Activity". Neuron 63 (6): 902–15. doi:10.1016/j.neuron.2009.09.006. PMID 19778517.
  5. ↑ Haynes, J; Rees, G (2005). "Predicting the Stream of Consciousness from Activity in Human Visual Cortex". Current Biology 15 (14): 1301–7. doi:10.1016/j.cub.2005.06.026. PMID 16051174.
  6. ↑ Polyn, S. M.; Natu, VS; Cohen, JD; Norman, KA (2005). "Category-Specific Cortical Activity Precedes Retrieval During Memory Search". Science 310 (5756): 1963–6. doi:10.1126/science.1117645. PMID 16373577.
  7. ↑ Suppes, Patrick; Perreau-Guimaraes, Marcos; Wong, Dik Kin (2009). "Partial Orders of Similarity Differences Invariant Between EEG-Recorded Brain and Perceptual Representations of Language". Neural Computation 21 (11): 3228–69. doi:10.1162/neco.2009.04-08-764. PMID 19686069.
  8. ↑ Suppes, Patrick; Han, Bing; Epelboim, Julie; Lu, Zhong-Lin (1999). "Invariance of brain-wave representations of simple visual images and their names". Proceedings of the National Academy of Sciences of the United States of America 96 (25): 14658–63. doi:10.1073/pnas.96.25.14658. PMC 24492. PMID 10588761.
  9. ↑ Chu, Carlton; Ni, Yizhao; Tan, Geoffrey; Saunders, Craig J.; Ashburner, John (2010). "Kernel regression for fMRI pattern prediction". NeuroImage 56 (2): 662–673. doi:10.1016/j.neuroimage.2010.03.058. PMC 3084459. PMID 20348000.
  10. ↑ Kay, Kendrick N.; Naselaris, Thomas; Prenger, Ryan J.; Gallant, Jack L. (2008). "Identifying natural images from human brain activity". Nature 452 (7185): 352–5. doi:10.1038/nature06713. PMC 3556484. PMID 18322462.
  11. 1 2 3 4 5 6 Wolpe, P. R., Foster, K. R., & Langleben, D. D. (2005). Emerging neurotechnologies for lie-detection: promises and perils. The American Journal Of Bioethics: AJOB, 5(2), 39-49.
  12. ↑ Farwell, L.A. & Donchin, E. (1991) The Truth Will Out: Interrogrative Polygraphy ("Lie Detection") with Event-Related Brain Potentials. Psychophysiology, 28(5), 531-547.
  13. ↑ Arstila, V., & Scott, F. (2011). BRAIN READING AND MENTAL PRIVACY. TRAMES: A Journal of the Humanities & Social Sciences, 15(2), 204-212. doi: 10.3176/tr.2011.2.08
  14. ↑ Kirchner, E. A., Kim, S. K., Straube, S., Seeland, A., Wöhrle, H., Krell, M. M., . . . Fahle, M. (2013). On the Applicability of Brain Reading for Predictive Human-Machine Interfaces in Robotics. PLoS ONE, 8(12), e81732. doi: 10.1371/journal.pone.0081732
  15. ↑ Surge in U.S. 'brain-reading' patents. (2015, May 7) BBC.com. Retrieved from http://www.bbc.com/news/technology-32623063

External links

This article is issued from Wikipedia - version of the Saturday, March 19, 2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.