Alan Berkson’s Post

AI companies such as OpenAI, Meta, Google, and Stability AI face a slew of lawsuits from artists who claim that their copyrighted material and personal information has been scraped without consent or compensation. Now they can fight back with a tool called Nightshade, that essentially "poisons" this training data. But it can also damage future iterations of image-generating AI models, such as DALL-E, Midjourney, and Stable Diffusion, by rendering some of their outputs useless. #artificialintelligence #generativeai #trainingdata #aimodels https://lnkd.in/efgcvXbK

Data poisoning and deadly nightshade - data rights holders are fighting back against the forced conscription of creators' outputs for AI training. Here, a tool enables artists to add unseen changes to the pixels that make up their art so that if it's scraped into a hungry AI training dataset, it will mess up the resulting model in "chaotic and unpredictable ways" #GenAI #SolveAI https://lnkd.in/ezwgEJ39

AI data poisoning is a new and emerging trend that could have serious implications for businesses that rely on AI systems and Liz Coll has shared a great article about how it's being used by artists to beat AI's thirst for data. Here is the original paper detailing the concept https://lnkd.in/evs8BeKc Like most well-documented vulnerabilities in systems, the AI developers will soon patch this particular exploit I suspect.

A research team led by professor Ben Zhao at the University of Chicago has developed a tool with the aim of protecting copyrighted art from being used without permission for Generative AI tools. The tool, called Nightshade, "adds invisible changes to the pixels in their art before they upload it online so that if it’s scraped into an AI training set, it can cause the resulting model to break in chaotic and unpredictable ways." It will be interesting how this new set of tools to protect creator's ownership evolve, not only for images but also for text or other content types. https://lnkd.in/d7TcMiGt #genai #dataprotection #intellectualproperty

The Nightshade tool allows artists to upload their work online and mask it with a different art style to prevent AI companies from scraping their images. Nightshade exploits a security vulnerability in generative AI models by poisoning the images scraped from the internet, causing the models to malfunction. Poisoned data samples can manipulate models into learning incorrect information, and the poisoned data is difficult to remove. Nightshade is open source, and the more people use it, the more powerful it becomes. The tool has the potential to deter #AI companies from using data without permission. https://lnkd.in/dHTuEXSP

A lot has been said about #AI indiscriminately scraping works of artists without their permission, not respecting #copyrights and the « total assymetry between technology companies and artists ».  An interesting new tool, which « lets artists add invisible changes to the pixels in their art before they upload it online so that if it’s scraped into an AI training set, it can cause the resulting model to break in chaotic and unpredictable ways », basically ‘poisoning’ the dataset. https://lnkd.in/ek-EW5kU

A new tool allows users to corrupt AI scraping 👩🎨✋🤖 #Nightshade allows artists to make invisible changes to the pixels in their art before uploading it online, so that when it's scraped into an AI training set, the resulting model can break in chaotic and unpredictable ways. Ben Zhao a professor at the University of Chicago who led the team that developed Nightshade, says the hope is that it will help tip the balance of power back from AI companies to artists by creating a strong deterrent against disrespecting artists' copyrights and intellectual property. #webscraping #texttoimage #generativeAI #midjourney #dalle #stablediffusion

Could art “poison” AI? This is a fascinating development. A protocol called “Nightshade” can modify digital art pixels to make them disruptive to AI training. Might this be a tool used to add DRM to art for digital rights management? Should it be? https://lnkd.in/gnK_mTHu #chatgpt #DALLE3 #midjourney

I love this concept of Data Poisoning Tools. Platforms like OpenAI and Stability AI are allowing artists to opt out of data scraping while training future generative AI models, I think it’s not enough. Till the time there is no process set keeping conscent and compensations in mind, tools like Nightshade and Glaze will be the nuisance for these platforms that everybody should think of adopting. #generativeai #artificialintelligence #datapoisoning

AI Wars: Return of the Artists! Artists now have a powerful ally in their fight against unauthorized AI usage. Nightshade, a groundbreaking tool created by Ben Zhao's team at the University of Chicago, empowers artists to protect their work by subtly altering pixels, causing chaos for image-generating AI models. Nightshade, designed to rebalance power from AI giants, such as OpenAI and Google, lets artists inject invisible changes into their art. This clever tool confuses AI models, making them see hats as cakes, handbags as toasters, and more. It not only affects specific terms but related concepts too. The Impact? Nightshade can be integrated into Glaze, a tool that masks artists' styles, making it even harder for AI to scrape their work. Open source and adaptable, the more people use it, the stronger the deterrent against unauthorized AI usage becomes. #AIWars #ArtistsRights #AIProtection #OpenAI #Google