[ai-control] Re: Considerations for AI Opt-Out

Chris Needham <chris.needham@bbc.co.uk> Fri, 17 May 2024 14:32 UTC

From: Chris Needham <chris.needham@bbc.co.uk>
To: Mark Nottingham <mnot=40mnot.net@dmarc.ietf.org>, "ai-control@ietf.org" <ai-control@ietf.org>
Thread-Topic: [ai-control] Considerations for AI Opt-Out
Thread-Index: AQHalEi6gy+nGrMY40a6hE5waoT51rGbpJFw
Date: Fri, 17 May 2024 14:31:56 +0000
Message-ID: <AM5PR01MB299431A3FBD50BD1F64E64F6A8EE2@AM5PR01MB2994.eurprd01.prod.exchangelabs.com>
References: <66D05E57-6474-414D-AF4C-409B063E970F@mnot.net>
In-Reply-To: <66D05E57-6474-414D-AF4C-409B063E970F@mnot.net>
Accept-Language: en-GB, en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: WplCcE8fVHzimNE3dm69Y8PgAmLmsyDXkdue4IsoJZ1YyVHQaWC++nsAZrKIoD6SNMe+NYujCvWPamvwOz6uJyl6hwG8i9AYkxYN8cYK05c+S9CCMghNbFR057cSwVykIgWfYaGBQYUTHDwCPHkEKkN8/9/LQPk2pwUr4GxI96WZaMtj7aJHPXnfmyOrEyoxwn3LMKwLLJZy5ocrWrel8zH0eMal1ZWVj89nQuInKe1Mf5yu6cvIqPZKJFlTR6VvQFFh/mcGqoFyB09CAxFtBvNWYF8jhpHV0hIc2V8V2ez9bo7cqky1GHQ59gYU+EWUoblkAduQrFjJl/UZc6dKsjlI3FWICpVbwiXBlfyA+zONzpvNCDM/CxMe8/vrJud9PFKcpftplcw60easA3vKmw/2wrplC2zKO1kA19dHP0DWp6ClKPFxIBKi0zq2u9OMPMmwPXsU+kLEJKGZFQ5wKRLmO28Kqc45pYNytE98Km04iUlAVOVqHJOhuYyY4Z2IqPnyLnwfdH9XlH94gPezq0JLFcPTCzlSf8eval643lOqcFs0tVzj9dZjbEvhxwK/PrQZvl5KwseKILOlfWUfzA0TPnnFeR7KL6LO5dWG98cx98n0juTnV5UH34IcijNVSG4mCkJQdJGlEg1oqHBKBVvDkQA/uGlU/JhGK35VxPMf/gWHIOELX1Oon1o92XtGfup+tpMR9af0W8QOHdsn6NffFHqOfU9i2PNolm8T2NjRA3GEV+auIFkt0v7DG+i93YXyWAJWGDwKSBc3az4VTjepnuCMzyB4EmkMVur8rkR0JBnxAQSn9ffFGSNEwbF6lvqNjqijen18dOzZCtE9sAPVajLFAvhADg+K3iz+H7HORO1PdGGhy2NJN7l5ozOMxfUOcOzx/DhJy7M2v4MNxW9choDvYRfAXgahZXVdodj7gr+LS64fpNzxVeZ8EdrBsAYjgD9mRx9KrBm27lKlCdkN/Ak4MRX5z09cILDHIvU45Txfa3g7qhDsucOxz4VlGEoOVSSBpIIczvsTvSYAUU6zcBDxVIEyPR/KAUqg4Y3phKi/j856dB/E55DbJni2xNyq/kU/ah9zy1PwS8p06Xn3tHbb5L9hT5lSGtak65kfFsufp/uwICWWGdWVvXyH8UMYfvVn68TkEgoBLHTlxcjzee1Xedws3UDfJ+AAFE6NWSy0OhaKnnlZCOI85jOcQWj4Bk/d7XnV4KbPYgbBLgHXZPzV9i8Qwixcil9+8OKvqieRFfli3c9NSQ7nmINchSbrIxlKTazf69ITPDGElQCyJHNJ0MVP2JHlkYjeAkVucr2zuyLL7QC0k0g4dp007F1RHcfQMZ39w2I2g0BkAkV5rHLlSTgTIhALoO1cZ+J81VxObzG9H37vqBwT3bDS4gie/lrI0H2wrr3zHe29LYmsCprEIwo3xYD8vgpBD6daz9aft9q4umG48BDZBKMWyDRpRizQvrZyAwOzoPuRTQs6JbXddCO/HukHjXaGFUNOg2yjvTCxwCETMVmyNzXDT4m9eLVEGSAZ/GGbgsUwK1WVNu7AGb+95SbTvPJ5ALy/X2fbTs6E7hW+yn5naVzI
arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=QwphxU4Kdo40Jkajdec8uznHU1ReeLfy+nEYuGycSONhjqL1MS8PKtnz38rxWyQwW+QqRKuxMEG19v8Qkqlneja4YUNAUBRXURT0MCPBXAdN78TVIbcyPDnQ1mwVfbiYbwjF0gn1ESiKFFrzHLZvnXaLfshp9eg0fVr+86HFt3GTslbXJPSHYevokVypUWq+WhkgcBoV0c9qgWtqwGGBxousD48dJci5ETOj0Zb52EnLb2T2belihzFwSCBTtFdxTROO1ycJnsS7X/TlXPUimHvbvxXfC3+QDx/iTsJg1xjt3KBLuxBIgp1zZk9bBGcmWDlFx4A21nMNCtePnZa6JQ==
arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=lCzLScR5nn2NtUcGIm88L0bKCUTs+NwDREwXSGojtds=; b=TW8VNq/OSxAl9clcLwsPvud6hdq3DF8ynRJC2LSOWchjjYERFnfJtcm/3VbgX8dxm0p6gF9CdcA3lU5MxtaC+RdYmrBgB08rDb3XGOZ8f/ge7TN+MAt0CmXRYfA1FmQ5SsqDcsDKGqbDs3JoV/s+HGP3QJfrri+NXpMGi2YB57Xq6r/MWmDRK6Sk/1819sQETxNWJWY/EJANetoffYfy5YXoQrac82YfT68PmCnUTksmqDexjum3Fj8HJBmlOElbs679vkD7kP7t3b2IKiDmYBBgOYNIWeP+OP3ZuSY4b51kUWdu8xNUlKfhHLc5MYx0Q7nbhO33MuEei0ZLsp2mHA==
arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=bbc.co.uk; dmarc=pass action=none header.from=bbc.co.uk; dkim=pass header.d=bbc.co.uk; arc=none
x-ms-exchange-antispam-externalhop-messagedata-chunkcount: 1
x-ms-exchange-antispam-externalhop-messagedata-0: v885acIssEbjFXKEZECkC2jeV180SWlOfoV4emfpys4XEWg6c83jW9TrSUZkbYahuP+SwuOGWD2BYvhbcOFQvcfUfEApP6jKhcyrVeqHO0hVP7Jvz8VQ9yM8LenWEpX7mifalwy2sSK5mQjOI0uhxvVhKHM+3Fg9DA6TU5/N6gCKyIrVfpseAR9mWoNeA+k5FRU4vTbHIudGaZXHHURTBq9DL4csxwdstLT1pbNGs044POxr6dA8bJKiMLkGA3+4w96hgl3M/+FYy1FxEFyaeZcOfh6V6VBzOVpxV371HXgpjJG1ZuVoWbwZlehrIrjVEq5PB55dWh/tMho4E9eoCdt14SmgpMp1znhle5ApvA1WL+hjrxzav2YyrJt4zaPq3U/WXwRVXMKS88SlF5ujO9fF6joKtqnw6RA568ChKnf8HGmZg86JSywQjdFgklHXrGpkQJsdJmHo6uGfBTr+ITgVFtcc8C4XoqSbv0vnsyIPaftzeYIRWlRpM9Sd46t/XhZ+FCLyK2dsHmRApIGaNs7DGvrK4wSzVMxqydcTYIGhZ0swILxisvRNBbBTTJSvpsA4wXbP+Si9bXn0jkVNaxTsq7lhraixOt/haFd/pKDvB6I+DRnfq/7RL3acTe8Puzp0SijJdb7yr9zmNHw2Z9CVbztWINS/56CHpm5WcSo=
x-ms-exchange-crosstenant-authas: Internal
x-ms-exchange-crosstenant-authsource: AM5PR01MB2994.eurprd01.prod.exchangelabs.com
x-ms-exchange-crosstenant-network-message-id: b03d3ba7-5814-435d-af80-08dc767e1afe
x-ms-exchange-crosstenant-originalarrivaltime: 17 May 2024 14:31:57.0090 (UTC)
x-ms-exchange-crosstenant-fromentityheader: Hosted
x-ms-exchange-crosstenant-id: 0e587133-568e-44d6-801d-2266bc52e5cf
x-ms-exchange-crosstenant-mailboxtype: HOSTED
x-ms-exchange-crosstenant-userprincipalname: +YKfl/kt8MtMRD2ZsR0VVzOn+W2zcviog4uUqWp7ebkrAs3o3LpKjNO6VlUi0N6fDDSa0Wv6IRxglKjBX0dXNQ==
x-ms-exchange-transport-crosstenantheadersstamped: AS8PR01MB7880
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: bbc.co.uk
X-EXCLAIMER-MD-CONFIG: c91d45b2-6e10-4209-9543-d9970fac71b7
X-TM-AS-Product-Ver: SMEX-14.0.0.3152-9.1.1006-28392.001
X-TM-AS-Result: No-10--22.271600-8.000000
X-TMASE-MatchedRID: Kx0w2sAofbu1TiWqZWCoj5rqyNtBcV3Xqf/efKFN1nA111eliAPtWYtp 6mm5u57++uKPhID6CVBcgbq1jL1p0200sCPwNg7wDOs94g784geC7C2rJeUToV+Tbf6gX6CHhEz I3+mkzieTwo0486VsknR582dM/fKGfsnkttz9l8gSRIeAOvh7hdvhAz8PvMa3TKLVP0BSBRtVPq FLH465CIYh1AXLMHng9eJMwOqecDzkjmTBn4CxZLa0rLOn7IyWC/ExpXrHizzWeQtrcncLfSTrW UB+VAmgOmOzfnCMj42fzSlgaxxZi0TErD57vBXGoS0guoV6SZc10wJPYcToKCWxD2S0xfx/K2gu GsQ9MyF1bfd6DJFTnjcxdfGyeZIGg6DXS0AI5zBFwy22bW6GA9hQO8CvZj/XFsz028Tu0fpEmR5 987QVT7lMXBKuvIsDUzrt5uEH+4IBpsK8qBoD3ng2y0j5vXZGNQO+lFC5/FVWEkFscBSzsvNaEi m+BfVwnVGdm/iKvgd1cgRJLEBdHCaj4YDmyyVIK0+leiJxLlewPJrVmmt35T+B/tp8itBT0PT0/ RHlp4Yz2qwOzAona7nsDuawR3R+Q6tklRJO9igLbigRnpKlKV2oFw52+PK5lExlQIQeRG0=
X-TM-AS-User-Approved-Sender: Yes
X-TM-AS-User-Blocked-Sender: No
X-TMASE-Result: 10--22.271600-8.000000
X-TMASE-Version: SMEX-14.0.0.3152-9.1.1006-28392.001
X-TM-SNTS-SMTP: 44E7E1360A1495B1D692CB61EEF041CFCF7A0C32094B42D3193C4246CECEC8082000:9
Message-ID-Hash: DX6GY4Y2ZO3EEGV36LZUEH4K5C5STAQJ
X-Message-ID-Hash: DX6GY4Y2ZO3EEGV36LZUEH4K5C5STAQJ
X-MailFrom: chris.needham@bbc.co.uk
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header
X-Mailman-Version: 3.3.9rc4
Precedence: list
Subject: [ai-control] Re: Considerations for AI Opt-Out
List-Id: AI Control <ai-control.ietf.org>
Archived-At: <https://mailarchive.ietf.org/arch/msg/ai-control/aTweHI_qevm0nFiPuES4yXzomyY>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ai-control>
List-Help: <mailto:ai-control-request@ietf.org?subject=help>
List-Owner: <mailto:ai-control-owner@ietf.org>
List-Post: <mailto:ai-control@ietf.org>
List-Subscribe: <mailto:ai-control-join@ietf.org>
List-Unsubscribe: <mailto:ai-control-leave@ietf.org>

Hi Mark, all,

I'm seeing a number of different technical solutions being developed or proposed, to add to the list you previously posted here:

W3C Text and Data Mining Community Group's TDM Reservation Protocol is a technical mechanism based on EU Directive 2019/790: https://www.w3.org/community/reports/tdmrep/CG-FINAL-tdmrep-20240202/

IPTC have: https://iptc.org/news/exclude-images-from-generative-ai-iptc-photo-metadata-standard-2023-1/

and C2PA has: https://c2pa.org/specifications/specifications/1.4/specs/C2PA_Specification.html#_training_and_data_mining

although now moved to Creator Assertions Working Group: https://creator-assertions.github.io/training-and-data-mining/1.0/

so I think aligning around a small number of solutions would be beneficial.

Responding to a few points in your blog post:

> Either solution above would make it easy for a site to opt-out of AI crawling of any sort without enumerating all of the potential AI crawlers in the world

There needs to be a solution for a global opt-out like this, and I'd suggest also more fine grained controls for particular "AI" use cases like generative AI training LLMs, detection and classification, or possibly for allowing some crawlers and not others.

> That means that on Facebook, Meta will decide whether your photos can be used to feed AI (theirs or others'), not you.

For specs like IPTC and CAWG's that embed the opt-outs in image or video assets, when content is voluntarily uploaded to such sites (rather than being scraped by them), would the social site's T&Cs apply, overriding any assertions in the content itself?

> However, It's not yet clear where or how this work will happen.

I was hoping something would result from Google's announcement last year, but I haven't heard any updates since, so maybe this list can help get things moving.

https://blog.google/technology/ai/ai-web-publisher-controls-sign-up/

Thanks,

Chris

-----Original Message-----
From: ai-control <ai-control-bounces@ietf.org> On Behalf Of Mark Nottingham
Sent: Monday, April 22, 2024 1:05 AM
To: ai-control@ietf.org
Subject: [ai-control] Considerations for AI Opt-Out

External: Think before clicking

I've written down a few thoughts about how appropriate it is to use robots.txt for opt-out:
  https://www.mnot.net/blog/2024/04/21/ai-control

I'd be interested to hear what people think.

Cheers,

--
Mark Nottingham   https://www.mnot.net/

--
ai-control mailing list
ai-control@ietf.org
https://www.ietf.org/mailman/listinfo/ai-control

[ai-control] Considerations for AI Opt-Out Mark Nottingham
Re: [ai-control] Considerations for AI Opt-Out Michael Prorock
Re: [ai-control] Considerations for AI Opt-Out Mark Nottingham
[ai-control] Re: Considerations for AI Opt-Out Chris Needham
[ai-control] Re: Considerations for AI Opt-Out Mark Nottingham
[ai-control] Re: Considerations for AI Opt-Out Martin Thomson