Skip to content
Last Dictionary

Joy Buolamwini

proper noun/BWOH-lahm-WEE-nee/

In plain wordsA Canadian-American computer scientist and activist whose research showed that face-analysis software works far worse on darker-skinned women, and who founded the Algorithmic Justice League.

  1. Canadian-born American computer scientist and campaigner against bias in AI systems, who founded the Algorithmic Justice League in 2016. As a graduate student at the MIT Media Lab she found that face-tracking software failed to detect her dark-skinned face until she put on a white mask, a bias she called the 'coded gaze'. Her thesis study Gender ShadesGender Shades, prop. n.: A 2018 study showing that commercial face-analysis software guessed the gender of darker-skinned women far less accurately than that of lighter-skinned men. (2018, with Timnit GebruTimnit Gebru, prop. n.: An Ethiopian-born American computer scientist who exposed racial and gender bias in AI systems, co-wrote the 'stochastic parrots' paper, and founded an independent AI research institute.) audited commercial gender-classification systems from IBM, Microsoft and Face++ and found error rates of up to about 35 percent for darker-skinned women against under 1 percent for lighter-skinned men; a 2019 follow-up with Inioluwa Deborah Raji extended the audit to Amazon. The audits became reference points in debates on algorithmic biasalgorithmic bias, n.: Unfairness in software that judges or serves people: it consistently produces worse results for some groups, such as women, older people or ethnic minorities, often because it learned from skewed or incomplete records. and facial recognitionfacial recognition, n.: Technology that identifies or checks who someone is by comparing a picture of their face with stored photos, used by phones, passport gates and police databases.: she testified to the US Congress in 2019, and in 2020 IBM, Amazon and Microsoft stopped or paused sales of the technology to police. Her work features in the documentary 'Coded Bias' (2020) and her book 'Unmasking AI' (2023).

Related

See also
  • Gender ShadesGender Shades, prop. n.: A 2018 study showing that commercial face-analysis software guessed the gender of darker-skinned women far less accurately than that of lighter-skinned men.
  • algorithmic biasalgorithmic bias, n.: Unfairness in software that judges or serves people: it consistently produces worse results for some groups, such as women, older people or ethnic minorities, often because it learned from skewed or incomplete records.
  • facial recognitionfacial recognition, n.: Technology that identifies or checks who someone is by comparing a picture of their face with stored photos, used by phones, passport gates and police databases.
  • Timnit GebruTimnit Gebru, prop. n.: An Ethiopian-born American computer scientist who exposed racial and gender bias in AI systems, co-wrote the 'stochastic parrots' paper, and founded an independent AI research institute.
  • AI auditAI audit, n.: An independent check of an AI system, or of the company using it, against agreed standards — for example, testing whether a hiring tool treats women and men fairly.
  • algorithmic fairnessalgorithmic fairness, n.: The effort to make automated decisions fair: to say in numbers what fair treatment means, measure whether a system achieves it, and correct the system if it does not.

Sources

  1. Buolamwini, J. & Gebru, T. (2018). Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. Proceedings of Machine Learning Research 81: 77–91.
  2. Buolamwini, J. (2023). Unmasking AI: My Mission to Protect What Is Human in a World of Machines. Random House.

Mentioned in

Gender ShadesGender Shades, prop. n.: A 2018 study showing that commercial face-analysis software guessed the gender of darker-skinned women far less accurately than that of lighter-skinned men., Timnit GebruTimnit Gebru, prop. n.: An Ethiopian-born American computer scientist who exposed racial and gender bias in AI systems, co-wrote the 'stochastic parrots' paper, and founded an independent AI research institute., Algorithmic Justice LeagueAlgorithmic Justice League, prop. n.: Joy Buolamwini's organization, known for showing that face-analysis software made far more mistakes with darker-skinned women, which campaigns to hold the makers of biased AI systems accountable.