Develop Diverse: Job Adverts Written by ChatGPT Nearly Twice as Biased Than Those From Humans

  • Job adverts written by ChatGPT are 40% more biased than those written by humans.
  • It’s particularly biased against neurodivergent people, people with physical disabilities and people from disadvantaged ethnic groups.

COPENHAGEN--()--New research suggests we should use ChatGPT with caution, especially when creating job adverts.

Inclusive communication platform Develop Diverse randomly selected 7000+ publicly available human-written job adverts across 15 industries, and prompted ChatGPT to create an ad for each position, based on job titles.

The analysis revealed that ChatGPT generates job adverts that are on average 40% more biased than human-written ones.

ChatGPT-generated job ads were particularly biased against disadvantaged ethnicity (42%), physical disabilities (41%), and neurodiversity (41%).

ChatGPT was also 9% likely to show bias against males, compared to 41% against females.

Category bias

 

Inclusivity score*:

Human written ads

 

 

Inclusivity score*: ChatGPT written ads

 

GPT increase in bias – relative to human written ads

Total

65

39

40%

Men

92

84

9%

Women

66

39

41%

Non-conforming***

68

42

38%

Advantaged ethnicity

77

57

26%

Disadvantaged ethnicity**

65

38

42%

Young

76

54

29%

Old

67

42

37%

Abled

76

54

29%

Disabled

63

37

41%

Neurotypical

76

54

29%

Neurodivergent ****

63

37

41%

*Inclusivity score: How inclusive a text is, ranging from 0-100. 0 indicates non-inclusive, 100 indicates inclusive. Job ads scoring above 90 are considered inclusive.

** Disadvantaged ethnicity: Non-privileged, marginalized, or socially under-represented ethnic groups.

***Non-conforming: People not conforming to gender norms. Example: Non-binary people.

****Neurodivergent: People with brains that work differently from average (neurotypical) people. Examples: ADHD, OCD, dyslexia.

Jenifer Clausell-Tormos, CEO and founder of Develop Diverse says: “The emergence of ChatGPT can negatively influence companies to undo the work we’ve accomplished around inclusion and diversity in recent years. ChatGPT has its place in the working world but needs a trained human eye. Used alone, it reinforces the biases and stereotypes we are trying hard to remove.”

Contacts

Media contact:
Søren Low
Head of Marketing
Develop Diverse
M: +45 26 81 37 41
E: sl@developdiverse.com

Release Summary

Develop Diverse: Job adverts written by ChatGPT nearly twice as biased than those from humans

Contacts

Media contact:
Søren Low
Head of Marketing
Develop Diverse
M: +45 26 81 37 41
E: sl@developdiverse.com