Vision chip
A vision chip is an integrated circuit having both image sensing circuitry and image processing circuitry on the same die. The image sensing circuitry may be implemented using charge-coupled devices, active pixel sensor circuits, or any other light sensing mechanism. The image processing circuitry may be implemented using analog, digital, or mixed signal (analog and digital) circuitry. One area of research is the use of neuromorphic engineering techniques to implement processing circuits inspired by biological neural systems. The output of a vision chip is generally a partially processed image or a high level information signal revealing something about the observed scene. Although there is no standard definition of a vision chip, the processing performed may comprise anything from processing individual pixel values to performing complex image processing functions and outputting a single value or yes/no signal based on the scene.
Types of processing performed in a vision chip
There is no standard definition of what constitutes a vision chip and thus the type of circuitry that may be performed. Below is a sample list of processing steps reported in vision chip designs, as reported in several books.:[1][2][3][4]
Light sensing techniques
- Active pixel sensors (APS)
- Charge coupled devices
- Logarithmic compression pixels
- Microbolometers for thermal imaging
Spatial processing techniques
- Lateral inhibition
- Artificial silicon retina circuits
- Contrast enhancement
- Edge or other static feature detection
Temporal processing techniques
- Intensity change detection
- Detection of visual motion / optical flow
Other techniques
- Cellular nonlinear networks
Commercially available vision chips
The overwhelming majority of vision chip designs were executed largely by academic institutions as part of research projects. However several designs have, at one point or another, been commercialized as a product.
- Optical mouse sensor: The sensor chip used in an optical mouse is a vision chip.
- Mitsubishi silicon retina chip[5]
See also
- optical flow sensor
- active pixel sensor
- charge-coupled device
- neuromorphic engineering
- Vision processing unit, a class of processor for accelerating machine vision, possibly including camera interfaces, but not directly including photosensitive elements
References
- ↑ Analog VLSI and Neural Systems, by Carver Mead, 1989
- ↑ Vision Chips: Implementing Vision Algorithms With Analog Vlsi Circuits, Ed. by Koch and Li, IEEE, 1995
- ↑ Analog VLSI Circuits for the Perception of Visual Motion, by Alan Stocker, Wiley and Sons, 2006
- ↑ Vision Chips, by Alireza Moini, Kluwer Academic Publishers, 2000
- ↑ E. Funatsu, K. Hara, T. Toyoda, J. Ohta & K. Kyuma, ``Variable-sensitivity photodetector of pn-np structure for optical neural networks, Japanese Journal of Applied Physics, Part 2 (Letters), Vol. 33, No. 1B, pp. L113-L115, January 1994.