The control over AI models is increasingly concentrated among a few private tech companies.This centralization poses challenges by limiting scrutiny and exacerbating the risks associated with opaque AI systems.Just as with our cafe analogy, where a few entities control all sandwich "ingredients" globally without sufficient oversight, the concentration of AI control raises concerns about accountability and fairness.This lack of diversity in AI development can lead to biases and limitations in innovation, as well as hinder efforts to ensure transparency and ethical use of AI technologies.

A Concentration of Power

To address these challenges, the author co-founded the Data Nutrition Project. This initiative creates "nutrition labels" for datasets, providing essential transparency about data quality and suitability for specific uses.These labels, similar to food nutrition labels, help developers and users understand the data before utilizing it in AI systems.Detailed insights into the data’s origins, completeness, and potential biases, these labels enable more informed decisions and promote the creation of more reliable and fair AI systems.

The Data Nutrition Project

Data is the cornerstone of AI systems. The quality and type of data used in training these systems significantly influence their performance.High-quality, representative data can lead to accurate and reliable AI outcomes, whereas poor-quality or biased data can result in flawed and harmful predictions.For example, a diabetes risk-assessment tool trained on a specific demographic might not work well for others, leading to harmful outcomes such as misdiagnosis or ineffective treatment recommendations.Ensuring data quality before use is essential for building trustworthy AI systems.

Data: The Fuel of AI

Imagine being offered a delicious sandwich from a cafe known for occasionally causing illness.The problem lies in the cafe's secrecy about the sandwich ingredients, making it impossible to address the issue. You don’t know if the ingredients are fresh, where they came from, or if they include allergens.This lack of information makes it impossible to ensure your safety. This scenario is analogous to how AI systems are developed and deployed today.The lack of transparency around the ingredients (data) and processes in AI leads to potential risks and harms that are difficult to mitigate.

The Sandwich Analogy

Historically, AI systems have been built for the "middle of the distribution"—the average user.This approach often excludes diverse populations, resulting in technology that doesn't adequately serve everyone.The speaker's personal experience as a non-binary, mixed-race individual with a hearing aid highlights this gap.They found that the systems they built often didn't work for people like them, exposing significant shortcomings in AI design.Building systems that do not represent all users can lead to significant inaccuracies and biases.

Building AI for the Middle

We live in what can be described as the Wild West of data. Assessing data quality is difficult due to the lack of global standards and regulations.This chaotic environment makes it challenging to ensure that the data used in AI systems is accurate, reliable, and free from bias. Just as food safety requires understanding ingredient sources, AI development necessitates transparency about data origins and quality.Without this transparency, it is nearly impossible to guarantee the integrity of AI systems.

The Wild West of Data

To foster a healthier relationship with AI, companies should adhere to three fundamental principles: transparency about data collection practices, clarity on how collected data will be used, and disclosure of the data used to train AI models.These principles are crucial for mitigating risks and building trust among users and stakeholders.By providing transparency about data sources and usage, companies can demonstrate accountability and ensure that AI development aligns with societal values and ethical standards.

Principles for a Healthier AI Relationship

Unlike the food industry, AI lacks comprehensive regulation. This gap leaves much room for ambiguity and potential misuse of data.The recent EU AI Act, which includes provisions for transparency labeling, is a step in the right direction. It acknowledges the need for clear guidelines and accountability in AI development.Regulations are crucial for enforcing data transparency and accountability, ensuring that companies adhere to best practices and ethical standards.By implementing robust regulatory measures, we can safeguard against the risks associated with opaque AI systems.

The Need for Regulation

The Data Nutrition Project has collaborated with organizations like Microsoft Research and the United Nations to integrate these labels into workflows and curricula.This collaboration represents a positive step towards standardizing data quality assessment in AI development. However, labeling every dataset remains a significant challenge due to the sheer volume and variety of data used in AI systems.Despite this difficulty, the importance of labeling lies in its potential to improve data quality and foster better practices in AI development.

Impact and Adoption

The journey towards AI accountability is ongoing.Projects like the Data Nutrition Project and emerging regulations are positive steps towards greater transparency and safety in AI development. These initiatives promote understanding and scrutiny of data used in AI systems, enhancing reliability and ethical standards.  Aligning with fundamental principles of data transparency and accountability, we can create an AI ecosystem that prioritizes fairness and benefits all stakeholders.This commitment to transparency not only builds trust but also fosters innovation.

Advancing AI Accountability: Towards a Transparent and Ethical Future

The demand for data is skyrocketing, driven by the requirements of generative AI techniques. Models such as GPT-3 and DBRX rely on massive datasets, often sourced from the internet without sufficient transparency regarding their origins and quality. This trend raises significant concerns about data integrity and the ethical implications of utilizing such vast amounts of information. As the reliance on large datasets continues to grow, so does the importance of establishing clear standards for data collection, ensuring that AI systems are developed responsibly and ethically.

The Growing Data Demand

Beyond regulation, cultural norms and best practices play a vital role in the responsible development and deployment of AI.Increasing awareness about data sensitivity and risks can drive the voluntary adoption of transparency measures among organizations.As more organizations recognize the importance of data quality, the practice of using data nutrition labels and similar tools is becoming more common.This shift towards transparency and accountability can help mitigate risks, ensuring that AI systems are built on reliable, unbiased data.

Cultural Norms and Best Practices

AI is pervasive in our daily lives. From online applications to bank accounts and passport control, algorithmic systems are everywhere.They streamline processes, improve efficiency, and offer personalized experiences. Despite its benefits, AI can also negatively impact certain populations, often along lines of race or gender.These biases can result in unfair treatment, such as discriminatory hiring practices or biased lending decisions.Understanding the ingredients of AI systems is crucial to addressing these disparities and ensuring safety and fairness.

The Ubiquity of AI

The rapid advancement of artificial intelligence (AI) has brought significant benefits to society, but it also poses considerable risks. This article explores the complexities and challenges of AI systems, drawing analogies to food safety to highlight the need for transparency and accountability. It delves into the current state of AI, the importance of understanding data quality, and offers principles for fostering a healthier relationship with AI technologies.

What do sandwiches have to do with AI? Data reformist Kasia Chmielinski helps us think about artificial intelligence with a useful food metaphor — and breaks down why AI systems should have "nutrition labels" to ensure the development of fairer, more transparent algorithms.

If you love watching TED Talks like this one, become a TED Member to support our mission of spreading ideas: https://ted.com/membership

Follow TED! 
X: https://twitter.com/TEDTalks
Instagram: https://www.instagram.com/ted
Facebook: https://facebook.com/TED
LinkedIn: https://www.linkedin.com/company/ted-conferences
TikTok: https://www.tiktok.com/@tedtoks

The TED Talks channel features talks, performances and original series from the world's leading thinkers and doers. Subscribe to our channel for videos on Technology, Entertainment and Design — plus science, business, global issues, the arts and more. Visit https://TED.com to get our entire library of TED Talks, transcripts, translations, personalized talk recommendations and more.

Watch more: https://go.ted.com/kasiachmielinski

https://youtu.be/orD3vsEyGdA

TED's videos may be used for non-commercial purposes under a Creative Commons License, Attribution–Non Commercial–No Derivatives (or the CC BY – NC – ND 4.0 International) and in accordance with our TED Talks Usage Policy: https://www.ted.com/about/our-organization/our-policies-terms/ted-talks-usage-policy. For more information on using TED for commercial purposes (e.g. employee learning, in a film or online course), please submit a Media Request at https://media-requests.ted.com

#TED #TEDTalks

cybersecurity

Cybersecurity

computerscience

Computer Science

podcasts

Podcasts

videos

Videos

artificialintelligence

Artificial Intelligence

The TED Talks channel features the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes (or less). Look for talks on Technology, Entertainment and Design -- plus science, business, global issues, the arts and more. You're welcome to link to or embed these videos, forward them to others and share these ideas with people you know.

TED's videos may be used for non-commercial purposes under a Creative Commons License, Attribution–Non Commercial–No Derivatives (or the CC BY – NC – ND 4.0 International) and in accordance with our TED Talks Usage Policy: https://www.ted.com/about/our-organization/our-policies-terms/ted-talks-usage-policy. For more information on using TED for commercial purposes (e.g. employee learning, in a film or online course), please submit a Media Request at https://media-requests.ted.com