Chernoff Faces–Introduction

In simple terms, “Chernoff faces” are a way to visualize big data.  The concept was created by Herman Chernoff in an 1973 paper, “The Use of Faces to Represent Points in k- Dimensional Space Graphically,” J. Am. Stat. Assoc., v68, pp. 361-368 (1973).  Chernoff used 18 facial features to create his faces to display large amounts of data, but his work is extensible.  We have extended his work to display 22 variables using our melody metrics.  Those already familiar with Chernoff faces can proceed directly to a detailed example in Chernoff Faces Explained.

The following figure is an example of a Chernoff face, annotated with the melodic metrics we used to draw the face.   We used melodies from the film genre to draw this example:

Linking Musical Metrics to Facial Features of Chernoff Faces
Linking Musical Metrics to Facial Features of Chernoff Faces

For a discussion of what Chernoff faces look like when drawn for the various musical genres in our database, go to the Chernoff Faces page. To be clear, the assignment of a specific metric to a specific Chernoff Face feature is somewhat arbitrary, but we were guided by the following principles:

[check_list]
  • Humans tend to focus on the eyes of a face, so we assign uncorrelated metrics to those features.
  • We needed to limit the number of metrics to 24 for the Chernoff faces, which means that 8 metrics had to be dropped. We dropped those metrics that were somewhat redundant by finding those that were highly correlated (over 99.8% correlation coefficient).  We retained some highly correlated metrics when doing so made the face look more “human.”
  • Some facial features, such as the width of the forehead and the separation of the eyes, go together, so we use correlated metrics for such features.
[/check_list]

Because we have a total of 32 metrics to describe our melodic data, we had to eliminate 8.  Our 32 metrics are described fully on the metric page, but we repeat them in the following table as they apply to musical genres and the drawing of Chernoff Faces:

Chernoff Face Features Matched to Metrics

Metric IDMetricHighly CorrelatedHighly UncorrelatedFacial Feature
0Average Number of Patterns in Tune#2, #18Hair Thickness
1Average Percent of Patterns Within a Tune#4, #29#13Forehead Width
2Average Number of Single-occurrence Patterns in Tune#0, #18#15, #17Face Height
3Average Percent of Single-occurrence Patterns as a Percent of Tune Patterns#25, #31Ear Dangle Angle
4Average Percent of Single-occurrence Patterns As a Percent of Notes#1, #29Eye Separation
5Average Number of Rests Per Note#6Smile Width
6Absolute Pitch Change Average#5Jaw Width
7Relative Pitch Change AverageVertical Position of Eyes
8Use of Common Patterns (Average Percent)#15#27Location of Pupils
9Average Percent of Tunes with Unique Patterns#30Unused (Can’t be applied to single tunes)
10Average Range of Tunes#14, #23Forehead Height
11Average Note Duration RatioSmile
12Average # Runs Per NoteJoining Forehead with Jaw
13Average Run Length#1Eye Squint
14Average Maximum Run Length#10, #23Eccentricity of Ears
15Average Number of Durations That Repeat#8#2Unused (covered by #8)
16Average Number of Pitches That RepeatEye Slant
17Weighted Average Spread of Two-Note Pattern Frequencies#2, #21Size of Eyes
18Unweighted Average Spread of Two-Note Pattern Frequencies#0, #2, #31Vertical Position of Mouth
19Average Pick-up Duration#20#23Unused (covered by #20)
20Average Pick-up Percent#19#24Ear Size
21Average Duration Ratio Going to Rests#17Vertical Position of Eyebrows
22Average Duration Ratio Coming from Rests#29Angle of Eyebrows
23Average Number of Different Pitches#10, #14, #24#13, #19Unused (covered by #24)
24Average Number of Different Pitch Differentials#23#20Length of Eyebrows
25Average Number of Different Durations#26, #31#3Unused (covered by #26 and #31)
26Average Number of Different Duration Ratios#25, #31Nostril Separation
27Average Normalized Number of Different Pitches#28#8Unused (covered by #28)
28Average Normalized Number of Pitch Differentials#27Vertical Position of Ears
29Average Normalized Number of Durations#1, #4, #30#22Unused (covered by #31)
30Average Normalized Number of Duration Ratios#29#9Nose Length
31Average Percent of Tunes with the Same Individual Patterns#18, #25, #26#3Unused (Can’t be applied to single tunes)
Correlations above 99.8%Correlations under 2%23 of 32 metrics used to draw Chernoff Faces
Table of all Skiptune metrics, correlations with each other, and assignments for drawing of Chernoff Faces.