Uploaded June 2022 | Updated September 2026, 2 weeks ago
The digital economy is built on data. It is a plentiful resource that can be extracted from just about everything in our lives, from our movements and the content we consume to the information about our environment, and more personal data such as our photos and videos, right down to our heart rate. Companies are using this data to inform product and service designs to get us to spend more money or time on their websites. This data can also be used to make decisions that affect our lives, such as the type of medical or insurance coverage we need, housing, employment and policing. When fundamental freedoms are determined by AI systems, it is incredibly important to know how they function and what types of bias may exist to identify possible harms.
In her essay, Mutale Nkonde explores the potential risks of biometric data and what regulators should do to protect vulnerable citizens.
Read The Four Domains of Global Platform Governance Essay Series at: cigionline.org/four-domains
The digital economy is built on data. It is a plentiful resource that can be extracted from just about everything in our lives, from our movements and the content we consume to the information about our environment, and more personal data such as our photos and videos, right down to our heart rate. Companies are using this data to inform product and service designs to get us to spend more money or time on their websites. This data can also be used to make decisions that affect our lives, such as the type of medical or insurance coverage we need, housing, employment and policing. When fundamental freedoms are determined by AI systems, it is incredibly important to know how they function and what types of bias may exist to identify possible harms.
In her essay, Mutale Nkonde explores the potential risks of biometric data and what regulators should do to protect vulnerable citizens.
Read The Four Domains of Global Platform Governance Essay Series at: cigionline.org/four-domains

![Big Tech - S3E09 - Mutale Nkonde on How Biased Tech Design and Racial Disparity Intersect
In this episode of Big Tech, Taylor Owen speaks with Mutale Nkonde, founder of AI for the People (AFP). She shares her experiences of discrimination and bias working in journalism and at tech companies in Silicon Valley. Moving into government, academia and activism, Nkonde has been able to bring light to the ways in which biases baked into technology’s design disproportionately affect racialized communities. For instance, during the 2020 US presidential campaign, her communications team was able to detect and counter groups who were targeting Black voters in social media groups, by weaponizing misinformation, with the specific message to not vote. In her role with AFP, she works to produce content that empowers people to combat racial bias in tech. One example is the “ban the scan” advocacy campaign with Amnesty International, which seeks to ban the use of facial recognition technology by government agencies.
In their conversation, Mutale and Taylor discuss the many ways in which technology reflects and amplifies bias. Many of the issues begin when software tools are designed by development teams that lack diversity or actively practise forms of institutional racism, excluding or discouraging decision-making participation by minority ethnic group members. Another problem is the data sets included in training the systems; as Nkonde explains, “Here in the United States, if you’re a white person, 70 percent of white people don’t actually know a Black person. So, if I were to ask one of those people to bring me a hundred pictures from their social media, it’s going to be a bunch of white people.” When algorithms that are built with this biased data make it into products — for use in, say, law enforcement, health care and financial services — they begin to have serious impacts on people’s lives, most severely when law enforcement misidentifies a suspect. Among the cases coming to light, “in New Jersey, Nijeer Parks was not only misidentified by a facial recognition system, arrested, but could prove that he was 30 miles away at the time,” Nkonde recounts. “But, because of poverty, [Parks] ended up spending 10 days in jail, because he couldn’t make bail. And that story really shows how facial recognition kind of reinforces other elements of racialized violence by kind of doubling up these systems.” Which is why Nkonde is working to ban facial recognition technology from use, as well as fighting for other legislation in the United States that will go beyond protecting individual rights to improving core systems for the good of all.
Learn more at https://www.bigtechpodcast.com
Big Tech podcast playlist on YouTube: https://www.youtube.com/playlist?list=PLRnfpAiVwGCewZSK4M1LTIcRyWPfo3JAS
Subscribe on:
Apple Podcasts https://podcasts.apple.com/podcast/big-tech/id1484910273
Spotify https://open.spotify.com/show/3i7GpvRRKksv76DzCcB34J Big Tech - S3E09 - Mutale Nkonde on How Biased Tech Design and Racial Disparity Intersect](https://i.ytimg.com/vi/VetwJpxvyt0/mqdefault.jpg)








