Heat map

Heat map generated from DNA microarray data reflecting gene expression values in several conditions

A heat map is a graphical representation of data where the individual values contained in a matrix are represented as colors. Fractal maps and tree maps both often use a similar system of color-coding to represent the values taken by a variable in a hierarchy.

History

The term "Heatmap" was originally coined and trademarked by software designer Cormac Kinney in 1991, to describe a 2D display depicting real time financial market information.^[1]

Heat maps originated in 2D displays of the values in a data matrix. Larger values were represented by small dark gray or black squares (pixels) and smaller values by lighter squares. Sneath (1957) displayed the results of a cluster analysis by permuting the rows and the columns of a matrix to place similar values near each other according to the clustering. Jacques Bertin used a similar representation to display data that conformed to a Guttman scale. The idea for joining cluster trees to the rows and columns of the data matrix originated with Robert Ling in 1973. Ling used overstruck printer characters to represent different shades of gray, one character-width per pixel. Leland Wilkinson developed the first computer program in 1994 (SYSTAT) to produce cluster heat maps with high-resolution color graphics. The Eisen et al. display shown in the figure is a replication of the earlier SYSTAT design.

Types

A heat map, atop a color bathymetric map, indicating the probable location of missing Malaysia Airlines Flight 370 based on a Bayesian method analysis of possible flight paths of the aircraft.^[2]

There are different kinds of heat maps:

• Web heat maps have been used for displaying areas of a Web page most frequently scanned by visitors. Web heatmaps are often used alongside other forms of web analytics and session replay tools.
• Biology heat maps are typically used in molecular biology to represent the level of expression of many genes across a number of comparable samples (e.g. cells in different states, samples from different patients) as they are obtained from DNA microarrays.
• The tree map is a 2D hierarchical partitioning of data that visually resembles a heat map.
• A mosaic plot is a tiled heat map for representing a two-way or higher-way table of data. As with treemaps, the rectangular regions in a mosaic plot are hierarchically organized. The means that the regions are rectangles instead of squares. Friendly (1994) surveys the history and usage of this graph.

Color schemes

There are many different color schemes that can be used to illustrate the heatmap, with perceptual advantages and disadvantages for each. Rainbow colormaps are often used, as humans can perceive more shades of color than they can of gray, and this would purportedly increase the amount of detail perceivable in the image. However, this is discouraged by many in the scientific community, for the following reasons:^{[3][4][5][6][7]}

• The colors lack the natural perceptual ordering found in grayscale or blackbody spectrum colormaps.
• Common colormaps (like the "jet" colormap used as the default in many visualization software packages) have uncontrolled changes in luminance that prevent meaningful conversion to grayscale for display or printing. This also distracts from the actual data, arbitrarily making yellow and cyan regions appear more prominent than the regions of the data that are actually most important.
• The changes between colors also lead to perception of gradients that aren't actually present, making actual gradients less prominent, meaning that rainbow colormaps can actually obscure detail in many cases rather than enhancing it.

Choropleth Maps vs. Heat Maps

Choropleth maps are sometimes incorrectly referred to as heat maps. A choropleth map features different shading or patterns within geographic boundaries to show the proportion of a variable of interest, whereas the coloration a heat map (in a map context) does not correspond to geographic boundaries.^[8]

Software implementations

A sample heat map created using a Surface Chart in Microsoft Excel.

Several heat map software implementations are listed here (the list is not complete):

• PermutMatrix is a work space designed to graphically explore numerical datasets. It offers several methods for the optimal reorganization of rows and columns of a numerical dataset.^[9]
• NeoVision Hypersystems, Inc., a software firm founded by Cormac Kinney, and funded by Intel and Deutsche Bank, developed Heatmaps depicting real time financial data and calculations, which were licensed to over 50,000 users. NeoVision Heatmaps became a feature on nasdaq.com.^[10]
• R, a free software environment for statistical computing and graphics, contains several functions to trace heat maps^[11][12]
• Gnuplot, a universal and free command-line plotting program, can trace 2D and 3D heat maps^[13]
• The Google Docs spreadsheet application includes a Heat Map gadget, but for country-wise data only, not for general matrix data.
• Dave Green's 'cubehelix' colour scheme provides resources for a colour scheme that prints as a monotonically increasing greyscale on black and white postscript devices^[14]
• Origin, a graphing and data analysis software can generate heat maps from data in a matrix, or a virtual matrix in a worksheet.
• Qlucore includes a heat map that is dynamically updated when filter parameters are changed.
• The ESPN Gamecast for soccer games uses heat maps to show where certain players have spent time on the field.
• Microsoft Excel can be used to generate heat maps using the Surface Chart. Though the default color range for Surface Charts in Excel is not conducive to heat maps, the colors can be edited to generate user-friendly and intuitive heat maps.
• Sightsmap is a sightseeing popularity heatmap overlaid on Google Maps, based on crowdsourcing: the number of Panoramio photos taken at each place in the world.
• Maptitude is business mapping software that includes a variety of customizable heat mapping tools and can use external data such as Excel files to show the results on geographic maps of your location.
• HeatMap Builder is a standalone application for generating heatmaps of genomic microarray data developed at the Ashley Lab at Stanford.^[15]

• Heat Map Software - DaqPlaner. For Personal Use.
• Heat Map Service - HeatMapCo.
• Data Visualization Tool - VisArt. Browser Based.
• Open Source Heatmap Software.

Examples

• 

  Geographical heat map of ocean salinity, using a rainbow colormap

• 

  Lake effect snow - weather radar information is usually shown using a heatmap.

• 

  Choropleth heatmap showing election results by municipality

• 

  Human voice visualized with a spectrogram; a heat map representing the magnitude of the STFT. An alternative visualization is the waterfall plot.

• 

  Example showing the relationships between a heat map, surface plot, and contour lines of the same data

• 

  Combination of surface plot and heatmap, where the surface height represents the amplitude of the function, and the color represents the phase angle.

References

Footnotes

1. "United States Patent and Trademark Office, registration #75263259". 1993-09-01.
2. MH370 - Definition of Underwater Search Areas (PDF) (Report). Australian Transport Safety Bureau. 3 December 2015.
3. Borland, David; Taylor, Russell (2007). "Rainbow Color Map (Still) Considered Harmful". IEEE Computer Graphics and Applications 27 (2): 14. doi:10.1109/MCG.2007.323435. PMID 17388198.
4. How NOT to Lie with Visualization - Bernice E. Rogowitz and Lloyd A. Treinish - IBM Thomas J. Watson Research Center, Yorktown Heights, NY
5. Harrower, Mark; Brewer, Cynthia A. (2003). "ColorBrewer.org: An Online Tool for Selecting Colour Schemes for Maps". In Dodge, Martin; Kitchin, Rob; Perkins, Chris. The Cartographic Journal. pp. 27–37. doi:10.1179/000870403235002042. ISBN 978-0-470-98007-1.
6. Green, D. A. (2011). "A colour scheme for the display of astronomical intensity images". Bulletin of the Astronomical Society of India 39: 289–95. arXiv:1108.5083. Bibcode:2011BASI...39..289G.
7. Borkin, M.; Gajos, K.; Peters, A.; Mitsouras, D.; Melchionna, S.; Rybicki, F.; Feldman, C.; Pfister, H. (2011). "Evaluation of Artery Visualizations for Heart Disease Diagnosis". IEEE Transactions on Visualization and Computer Graphics 17 (12): 2479–88. doi:10.1109/TVCG.2011.192. PMID 22034369.
8. http://www.gretchenpeterson.com/blog/archives/2694
9. Caraux, G.; Pinloche, S. (2004). "Permut Matrix: A graphical environment to arrange gene expression profiles in optimal linear order". Bioinformatics 21 (7): 1280–1. doi:10.1093/bioinformatics/bti141. PMID 15546938.
10. Sansoni, Silvia (1999-05-17). "Forbes Magazine Article on NeoVision Heatmaps".
11. "Using R to draw a Heatmap from Microarray Data". Molecular Organisation and Assembly in Cells. 26 Nov 2009.
12. "Draw a Heat Map". R Manual.
13. http://gnuplot.sourceforge.net/demo_4.4/heatmaps.html[]
14. http://www.mrao.cam.ac.uk/~dag/CUBEHELIX/[]
15. "Tools & Scripts | Ashley Lab - Stanford Medicine". ashleylab.stanford.edu. Retrieved 2015-09-21.

Bibliography

• Bertin, J. (1967). Sémiologie Graphique. Les diagrammes, les réseaux, les cartes [Graphic semiotics. Diagrams, networks, maps] (in French). Gauthier-Villars. OCLC 2656278.
• Eisen, M. B.; Spellman, P. T.; Brown, P. O.; Botstein, D (1998). "Cluster analysis and display of genome-wide expression patterns". Proceedings of the National Academy of Sciences of the United States of America 95 (25): 14863–14868. Bibcode:1998PNAS...9514863E. doi:10.1073/pnas.95.25.14863. PMC 24541. PMID 9843981.
• Friendly, Michael (March 1994). "Mosaic Displays for Multi-Way Contingency Tables". Journal of the American Statistical Association 89 (425): 190–200. doi:10.1080/01621459.1994.10476460. JSTOR 2291215.
• Ling, Robert L. (1973). "A computer generated aid for cluster analysis". Communications of the ACM 16 (6): 355. doi:10.1145/362248.362263.
• Sneath, P. H. A. (1957). "The Application of Computers to Taxonomy". Journal of General Microbiology 17 (1): 201–26. doi:10.1099/00221287-17-1-201. PMID 13475686.
• Wilkinson, L. (1994). Advanced Applications: Systat for DOS Version 6. SYSTAT. ISBN 978-0-13-447285-0.

External links

• The History of the Cluster Heat Map. Leland Wilkinson and Michael Friendly.
• Albergotti, Reed (May 7, 2014). "Strava, Popular With Cyclists and Runners, Wants to Sell Its Data to Urban Planners". The Wall Street Journal.