Social Perception of Faces in a Vision-Language Model

The authors measured social bias of CLIP models by using social perception language prompts and synthetic images. They found out that CLIP is able to make fine-grained human-like social judgments on face images, and that facial expression impacts social perception more than age and lighting.