The Entrepreneurs Weekly
No Result
View All Result
Tuesday, July 1, 2025
  • Login
  • Home
  • BUSINESS
  • POLITICS
  • ENTREPRENEURSHIP
  • ENTERTAINMENT
Subscribe
The Entrepreneurs Weekly
  • Home
  • BUSINESS
  • POLITICS
  • ENTREPRENEURSHIP
  • ENTERTAINMENT
No Result
View All Result
The Entrepreneurs Weekly
No Result
View All Result
Home Business

We Forgot To Give Neural Networks The Ability To Forget

by Brand Post
January 25, 2023
in Business
0
We Forgot To Give Neural Networks The Ability To Forget
152
SHARES
1.9k
VIEWS
Share on FacebookShare on Twitter


A conversation about artificial intelligence’s current inability to forget and what this means for the right to privacy and user agency. Miguel Luengo-Oroz, AI expert and social entrepreneur, speaks with Ashoka’s Hanae Baruchel. (Full bio below.)

Hanae Baruchel: ChatGPT and other generative artificial intelligence (AI) apps have been making headlines recently because of their unprecedented ability to have coherent conversations with humans. You had an interaction of your own recently.

Founder and CEO of Spotlab

Miguel Luengo

Miguel Luengo-Oroz: Yes, I asked GPT-3 “Can neural networks forget?” and its response was that “Artificial intelligence systems, like neural networks, do not have the ability to forget in the same way that humans do. The network may adjust its weights to better fit the new data, which could result in it making different predictions for the same input. However, this is not the same as forgetting in the sense that the network still has access to all of the information it has learned previously, it is just prioritizing the new information more highly.”

Baruchel: This inability to forget isn’t getting much attention and this concerns you. Why?

Luengo-Oroz: One of the core principles of online privacy regulations like Europe’s General Data Protection Regulation (GDPR) is the idea that the data I produce is mine, and a company can use it only if I allow it to. This means I can always withdraw my consent and ask for my data back. I can even ask for the right to be forgotten. AI algorithms are trained in part on user data, and yet, almost none of the guidelines, frameworks and regulatory proposals emerging from governments and private sector companies explicitly focus on building AI models that can be untrained. We don’t have a way to reverse the changes induced in their system by a single data point at the request of a data owner.

Baruchel: So users should have the ability to say: “Stop using the AI model that was trained with my data”?

Luengo-Oroz: Exactly. Let’s give AIs the ability to forget. Think of it as the Ctrl-Z button of AI. Let’s say my picture was used to train an AI model that recognizes people with blue eyes and I don’t consent anymore, or never did. I should be able to ask the AI model to behave as if my picture had never been included in the training dataset. This way, my data would not contribute to fine tuning the model’s internal parameters. In the end, this may not affect the AI so much because my picture unlikely made a substantial contribution on its own. But we can also imagine a case where all people with blue eyes request that their data not influence the algorithm, making it impossible for it to recognize people with blue eyes. Let’s imagine in another example that I’m Vincent van Gogh and I don’t want my art to be included in the training dataset of an algorithm. If someone then asks the machine to paint a dog in the style of Vincent van Gogh, it would not be able to execute that task.

Baruchel: How would this work?

Luengo-Oroz: In artificial neural networks, every time a data point is used to train an AI model it slightly alters the way each artificial neuron behaves. One way to remove this contribution, is to fully retrain the AI model without the data point in question. But this is not a practical solution because it requires too much computing power and it is too resource intensive. Instead, we need to find a technical solution that reverses the influence of this data point, changing the final AI model without having to train it all over again.

Baruchel: Are you seeing people in the AI community pursuing such ideas?

Luengo-Oroz: So far, the AI community has done little specific research on the idea of untraining neural networks, but I’m sure there will be clever solutions soon. There are adjacent ideas to get inspiration from such as the concept of “catastrophic forgetting,” the tendency of AI models to forget previously learned information upon learning new information. The big picture of what I am suggesting here is that we build neural nets that are not just sponges that immortalize all the data they suck in, like stochastic parrots. We need to build dynamic entities that adapt and learn from the datasets they are allowed to use.

Baruchel: Beyond the right to be forgotten, you suggest that this kind of traceability could also bring about big innovations when it comes to digital property rights.

Luengo-Oroz: If we were able to trace what user-data contributed to training specific AI models, this could become a mechanism to compensate people for their contributions. As I wrote back in 2019, we could think of some sort of Spotify model that rewards humans with royalties each time someone uses an AI trained with their data. In the future, this type of solution could ease the tense relationship between the creative industry and generative AI tools like DALL-E or GPT-3. It could also lay the groundwork for concepts like Forgetful Advertising, a new ethical digital advertising model that would purposefully avoid the storage of personal behavioral data. Maybe the future of AI is not just about learning it all –the bigger the data set and the bigger the AI model, the better— but about building AI systems that can learn and forget as humanity wants and needs.

Dr. Miguel Luengo-Oroz is a scientist and entrepreneur passionate about imagining and building technology and innovation for social impact. As the former first chief data scientist at the United Nations, Miguel pioneered the use of artificial intelligence for sustainable development and humanitarian action. Miguel is the founder and CEO of the social enterprise Spotlab, a digital health platform leveraging the best AI and mobile technologies for clinical research and universal access to diagnosis. Over the last decade, Miguel has built teams worldwide bringing AI to operations and policy in domains including poverty, food security, refugees and migrants, conflict prevention, human rights, economic development, gender, hate speech, privacy and climate change. He is the inventor of Malariaspot.org –videogames for collaborative malaria image analysis–, and is affiliated with the Universidad Politécnica de Madrid. He became an Ashoka Fellow in 2013.

Follow Next Now/Tech & Humanity for more on what works and what’s next.



Source link

Tags: AbilityAgencyaiArtificial IntelligenceChatGPTethical AIForgetForgotGDPRgenerative AIGiveNetworksNeuralneural networksprivacyresponsible tech

Related Posts

AI Startup TML From Ex-OpenAI Exec Mira Murati Pays 0,000 | Entrepreneur
Business

AI Startup TML From Ex-OpenAI Exec Mira Murati Pays $500,000 | Entrepreneur

July 1, 2025
Why Your Finance Team Needs an AI Strategy, Now | Entrepreneur
Business

Why Your Finance Team Needs an AI Strategy, Now | Entrepreneur

July 1, 2025
He Went From 1K in Debt to Teaching Others How to Succeed | Entrepreneur
Business

He Went From $471K in Debt to Teaching Others How to Succeed | Entrepreneur

July 1, 2025
  • Trending
  • Comments
  • Latest
Meet Amir Kenzo: A Well Known Musical Artist From Iran.

Meet Amir Kenzo: A Well Known Musical Artist From Iran.

August 21, 2022
Behind the Glamour: Bella Davis Opens Up About Overcoming Adversity in Modeling

Behind the Glamour: Bella Davis Opens Up About Overcoming Adversity in Modeling

April 20, 2024
Dr. Donya Ball: Pioneering Leadership Solutions for Tomorrow’s Challenges

Dr. Donya Ball: Pioneering Leadership Solutions for Tomorrow’s Challenges

May 10, 2024
Nasiyr Bey’s Journey from Brooklyn to Charlotte: The Entrepreneurial Path to Owning a Successful Cigar Lounge

Nasiyr Bey’s Journey from Brooklyn to Charlotte: The Entrepreneurial Path to Owning a Successful Cigar Lounge

August 8, 2024
Augmented.City Startup Developers Appeal To US Politicians With An Open Letter

Augmented.City Startup Developers Appeal To US Politicians With An Open Letter

0
U.S. High Court Snubs Challenge To State And Local Tax Deduction Cap

U.S. High Court Snubs Challenge To State And Local Tax Deduction Cap

0
GOP Lawmaker Blames Biden For Russia-Ukraine War: Putin ‘Could never have Invaded’

GOP Lawmaker Blames Biden For Russia-Ukraine War: Putin ‘Could never have Invaded’

0
Brad Winget’s Tips and Tricks on Having a Career in Real Estate

Brad Winget’s Tips and Tricks on Having a Career in Real Estate

0
AI Startup TML From Ex-OpenAI Exec Mira Murati Pays 0,000 | Entrepreneur

AI Startup TML From Ex-OpenAI Exec Mira Murati Pays $500,000 | Entrepreneur

July 1, 2025
Why Your Finance Team Needs an AI Strategy, Now | Entrepreneur

Why Your Finance Team Needs an AI Strategy, Now | Entrepreneur

July 1, 2025
He Went From 1K in Debt to Teaching Others How to Succeed | Entrepreneur

He Went From $471K in Debt to Teaching Others How to Succeed | Entrepreneur

July 1, 2025
How One Founder Is Rethinking Supplements With David Beckham | Entrepreneur

How One Founder Is Rethinking Supplements With David Beckham | Entrepreneur

July 1, 2025

The EW prides itself on assembling a proficient and dedicated team comprising seasoned journalists and editors. This collective commitment drives us to provide our esteemed readership with nothing short of the most comprehensive, accurate, and captivating news coverage available.

Transcending the bounds of Chicago to encompass a broader scope, we ensure that our audience remains well-informed and engaged with the latest developments, both locally and beyond.

NEWS

  • Business
  • Politics
  • Entrepreneurship
  • Entertainment
Instagram Facebook

© 2024 Entrepreneurs Weekly.  All Rights Reserved.

  • About Us
  • Advertise
  • Contact Us
No Result
View All Result
  • ENTREPRENEURSHIP
  • ENTERTAINMENT
  • POLITICS
  • BUSINESS
  • CONTACT US
  • ADVERTISEMENT

Copyright © 2024 - The Entrepreneurs Weekly

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In