Heat map

Heat map generated from DNA microarray data reflecting gene expression values in several conditions

A heat map (or heatmap) is a graphical representation of data where the individual values contained in a matrix are represented as colors. Fractal maps and tree maps both often use a similar system of color-coding to represent the values taken by a variable in a hierarchy.

History

The term Heatmap was originally coined and trademarked by software designer Cormac Kinney in 1991, to describe a 2D display depicting real time financial market information.^[1]

Heat maps originated in 2D displays of the values in a data matrix. Larger values were represented by small dark gray or black squares (pixels) and smaller values by lighter squares. Sneath (1957) displayed the results of a cluster analysis by permuting the rows and the columns of a matrix to place similar values near each other according to the clustering. Jacques Bertin used a similar representation to display data that conformed to a Guttman scale. The idea for joining cluster trees to the rows and columns of the data matrix originated with Robert Ling in 1973. Ling used overstruck printer characters to represent different shades of gray, one character-width per pixel. Leland Wilkinson developed the first computer program in 1994 (SYSTAT) to produce cluster heat maps with high-resolution color graphics. The Eisen et al. display shown in the figure is a replication of the earlier SYSTAT design.

Types

A heat map, atop a color bathymetric map, indicating the probable location of missing Malaysia Airlines Flight 370 based on a Bayesian method analysis of possible flight paths of the aircraft.^[2]

There are different kinds of heat maps:

• Web heat maps have been used for displaying areas of a Web page most frequently scanned by visitors. Web heatmaps are often used alongside other forms of web analytics and session replay tools.
• Biology heat maps are typically used in molecular biology to represent the level of expression of many genes across a number of comparable samples (e.g. cells in different states, samples from different patients) as they are obtained from DNA microarrays.
• The tree map is a 2D hierarchical partitioning of data that visually resembles a heat map.
• A mosaic plot is a tiled heat map for representing a two-way or higher-way table of data. As with treemaps, the rectangular regions in a mosaic plot are hierarchically organized. The means that the regions are rectangles instead of squares. Friendly (1994) surveys the history and usage of this graph.
• A density function visualization is a heat map for representing the density of dots in a map. It enables one to perceive density of points independently of the zoom factor. Perrot et al (2015) proposed a way to use density function to visualize billions of dots using big data infrastructure with Spark and Hadoop.^[3]

Colour schemes

There are many different color schemes that can be used to illustrate the heatmap, with perceptual advantages and disadvantages for each. Rainbow colormaps are often used, as humans can perceive more shades of color than they can of gray, and this would purportedly increase the amount of detail perceivable in the image. However, this is discouraged by many in the scientific community, for the following reasons:^{[4][5][6][7][8]}

• The colors lack the natural perceptual ordering found in grayscale or blackbody spectrum colormaps.
• Common colormaps (like the "jet" colormap used as the default in many visualization software packages) have uncontrolled changes in luminance that prevent meaningful conversion to grayscale for display or printing. This also distracts from the actual data, arbitrarily making yellow and cyan regions appear more prominent than the regions of the data that are actually most important.
• The changes between colors also lead to perception of gradients that aren't actually present, making actual gradients less prominent, meaning that rainbow colormaps can actually obscure detail in many cases rather than enhancing it.

Choropleth maps vs. heat maps

Choropleth maps are sometimes incorrectly referred to as heat maps. A choropleth map features different shading or patterns within geographic boundaries to show the proportion of a variable of interest, whereas the coloration a heat map (in a map context) does not correspond to geographic boundaries.^[9]

Software implementations

A sample heat map created using a Surface Chart in Microsoft Excel.

Several heat map software implementations are listed here (the list is not complete):

• PermutMatrix is a work space designed to graphically explore numerical datasets. It offers several methods for the optimal reorganization of rows and columns of a numerical dataset.^[10]
• NeoVision Hypersystems, Inc., a software firm founded by Cormac Kinney, and funded by Intel and Deutsche Bank, developed Heatmaps depicting real time financial data and calculations, which were licensed to over 50,000 users. NeoVision Heatmaps became a feature on nasdaq.com.^[11]
• R, a free software environment for statistical computing and graphics, contains several functions to trace heat maps^[12][13]
• Gnuplot, a universal and free command-line plotting program, can trace 2D and 3D heat maps^[14]
• The Google Docs spreadsheet application includes a Heat Map gadget, but for country-wise data only, not for general matrix data.
• Dave Green's 'cubehelix' colour scheme provides resources for a colour scheme that prints as a monotonically increasing greyscale on black and white postscript devices^[15]
• Origin, a graphing and data analysis software can generate heat maps from data in a matrix, or a virtual matrix in a worksheet.
• Qlucore includes a heat map that is dynamically updated when filter parameters are changed.
• The ESPN Gamecast for soccer games uses heat maps to show where certain players have spent time on the field.
• Microsoft Excel can be used to generate heat maps using the Surface Chart. Though the default color range for Surface Charts in Excel is not conducive to heat maps, the colors can be edited to generate user-friendly and intuitive heat maps.
• Sightsmap is a sightseeing popularity heatmap overlaid on Google Maps, based on crowdsourcing: the number of Panoramio photos taken at each place in the world.
• Maptitude is business mapping software that includes a variety of customizable heat mapping tools and can use external data such as Excel files to show the results on geographic maps of your location.^[16]
• HeatMap Builder is a standalone application for generating heatmaps of genomic microarray data developed at the Ashley Lab at Stanford.^[17]
• Heat Map Software - DaqPlaner. For Personal Use.
• Heat Map Service - HeatMapCo.
• Data Visualization Tool - VisArt. Browser Based.
• Open Source Heatmap Software.
• Littlstar provides a heatmap service for 360 degree video and Virtual Reality.
• Hotjar Heatmap Web App.

Examples

• 

  Geographical heat map of ocean salinity, using a rainbow colormap

• 

  Lake effect snow - weather radar information is usually shown using a heatmap.

• 

  Choropleth heatmap showing election results by municipality

• 

  Human voice visualized with a spectrogram; a heat map representing the magnitude of the STFT. An alternative visualization is the waterfall plot.

• 

  Example showing the relationships between a heat map, surface plot, and contour lines of the same data

• 

  Combination of surface plot and heatmap, where the surface height represents the amplitude of the function, and the color represents the phase angle.

• 

  Score of each contiguous region of a dartboard (not to scale)

References

Footnotes

Bibliography

• Bertin, J. (1967). Sémiologie Graphique. Les diagrammes, les réseaux, les cartes [Graphic semiotics. Diagrams, networks, maps] (in French). Gauthier-Villars. OCLC 2656278. 
• Eisen, M. B.; Spellman, P. T.; Brown, P. O.; Botstein, D (1998). "Cluster analysis and display of genome-wide expression patterns". Proceedings of the National Academy of Sciences of the United States of America. 95 (25): 14863–14868. Bibcode:1998PNAS...9514863E. doi:10.1073/pnas.95.25.14863. PMC 24541. PMID 9843981. 
• Friendly, Michael (March 1994). "Mosaic Displays for Multi-Way Contingency Tables". Journal of the American Statistical Association. 89 (425): 190–200. doi:10.1080/01621459.1994.10476460. JSTOR 2291215. 
• Ling, Robert L. (1973). "A computer generated aid for cluster analysis". Communications of the ACM. 16 (6): 355. doi:10.1145/362248.362263. 
• Sneath, P. H. A. (1957). "The Application of Computers to Taxonomy". Journal of General Microbiology. 17 (1): 201–26. doi:10.1099/00221287-17-1-201. PMID 13475686. 
• Wilkinson, L. (1994). Advanced Applications: Systat for DOS Version 6. SYSTAT. ISBN 978-0-13-447285-0. 
• Perrot, A.; Bourqui, R.; Hanusse, N.; Lalanne, F.; Auber, D. (2015). "Large interactive visualization of density functions on big data infrastructure". IEEE 5th Symposium on Large Data Analysis and Visualization (LDAV), 2015: 99–106. doi:10.1109/LDAV.2015.7348077. 

External links

• The History of the Cluster Heat Map. Leland Wilkinson and Michael Friendly.
• Albergotti, Reed (May 7, 2014). "Strava, Popular With Cyclists and Runners, Wants to Sell Its Data to Urban Planners". The Wall Street Journal.