Facial Affect (Image Coding)

Paul Ekman, Wallace V. Friesen · 1971

Ekman's six basic emotions applied to still images and video frames — draw a box on the face and code the affect it displays.

The image counterpart to the Ekman's Basic Emotions text scale: the same six cross-culturally recognized categories — anger, disgust, fear, happiness, sadness and surprise — coded from what a face displays rather than from what a speaker says.

Intended for detection studies. Draw a box around each face and assign the emotion category it displays. In a recognition study, use it to mark which affects are present anywhere in the frame. One face may legitimately carry two codes — blends are common, and coding both is more honest than forcing a winner.

What this is not. It is not FACS. FACS codes anatomical action units (AU6 + AU12 and so on) and requires certified training; its manual is licensed and is not reproduced here. This scheme records the emotion category a trained rater perceives, which is a different and coarser judgment — appropriate for reliability work and supervision review, not for claims about specific facial musculature.

Severity is clarity, not intensity. For visual codes the useful question is how legible the display is, not how strongly the person feels: a face at the edge of frame, motion-blurred, or half-occluded is a partial reading no matter how vivid the expression looks. Rate what you can actually see.

Neutral faces are left untagged rather than given a code, so that a neutral reading is distinguishable from a face nobody looked at.

Domains (6)

AngerANG

Brows drawn down and together, tightened lids, compressed or squared lips — a display read as hostility or rage.

Curated skill
DisgustDIS

Nose wrinkle, raised upper lip, often with a lowered brow — a display read as revulsion or distaste.

Curated skill
FearFEA

Raised and drawn-together brows, widened eyes with visible upper sclera, horizontally stretched lips.

Curated skill
HappinessHAP

Raised lip corners with orbital tightening (crow's feet) — the eye involvement is what separates it from a social smile.

Curated skill
SadnessSAD

Inner brow corners raised, downturned lip corners, drooping upper lids.

Curated skill
SurpriseSUR

Raised brows, widened eyes, dropped jaw — brief, and valence-neutral until appraised.

Curated skill
Ekman P, Friesen WV. Constants across cultures in the face and emotion. Journal of Personality and Social Psychology. 1971;17(2):124-129. doi:10.1037/h0030377

Conceptual framework — free to operationalize with citation. Category definitions here are Tagaroo's own operational wording for image coding. This scheme deliberately does NOT reproduce the Facial Action Coding System (FACS), whose manual is a separately licensed publication; it codes the emotion category a rater perceives, not FACS action units.