AI Representations of Mental Health Stigma: Quantifying the Gap Between AI Estimations and Human Perceptions Across Gender Groups Using GPT-Based LLMs

Soojong Kim, Hye Min Kim, Kwanho Kim, Dongdong Zhu

The increasing use of artificial intelligence (AI) in mental health applications raises concerns about its potential to internalize and perpetuate societal biases. This research evaluates both disparities and misalignment in how large language models (LLMs), GPT-4 and GPT-5, represent perceptions of mental health across gender groups. The research comprises two studies. Study 1 applied widely adopted measures of Social Distance, Stereotypes, and Attitudes Toward Seeking Help to assess whether the AI models depict systematic gender differences. Study 2 compared AI estimations of Personal, Self, and Perceived Stigma with large-scale real-world human data from the Healthy Minds Study (N = 76,406) to evaluate alignment between AI estimations and human perceptions. Results from Study 1 showed the AI models consistently portrayed men as having the greatest desire for social distance from someone with mental health problems, relatively higher Stereotypes scores, and the least favorable attitudes toward help-seeking, compared with women and nonbinary individuals. Study 2 confirmed that this ordinal pattern partially aligned with human-reported data for Personal and Self Stigma. However,…