Re: [ai-control] Considerations for AI Opt-Out

Mark Nottingham <mnot@mnot.net> Tue, 23 April 2024 00:26 UTC

Return-Path: <mnot@mnot.net>
X-Original-To: ai-control@ietfa.amsl.com
Delivered-To: ai-control@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 95E59C151095 for <ai-control@ietfa.amsl.com>; Mon, 22 Apr 2024 17:26:51 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -7.096
X-Spam-Level:
X-Spam-Status: No, score=-7.096 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=mnot.net header.b="IwFzylg2"; dkim=pass (2048-bit key) header.d=messagingengine.com header.b="PTZcQAJ8"
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ETTqj3FbRtd2 for <ai-control@ietfa.amsl.com>; Mon, 22 Apr 2024 17:26:46 -0700 (PDT)
Received: from wfout3-smtp.messagingengine.com (wfout3-smtp.messagingengine.com [64.147.123.146]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id D2F49C14F685 for <ai-control@ietf.org>; Mon, 22 Apr 2024 17:26:46 -0700 (PDT)
Received: from compute7.internal (compute7.nyi.internal [10.202.2.48]) by mailfout.west.internal (Postfix) with ESMTP id 8470C1C00122; Mon, 22 Apr 2024 20:26:45 -0400 (EDT)
Received: from mailfrontend2 ([10.202.2.163]) by compute7.internal (MEProxy); Mon, 22 Apr 2024 20:26:45 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mnot.net; h=cc :cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm1; t=1713832005; x=1713918405; bh=4UxVo9NXXFAGCyxnku4sudL1IS2yoVvqiOTpyvx/Q3o=; b= IwFzylg2jNIQCFV1m3jTby+akH3mkJF5cuS522k6V7LH5rwNpLyrtZ9S1++0a7Yt nNdDcfATYYG75QjS6l0I6ZfAApJChsfhr0XH03I2nu12J6WgfheFS1kCiAM1isE2 jNFitG7LPxoZTYEzcHEsO/TsScMsvB0L5Q6fFqzx9A7Z8KdcDfmi/TfJN6Gbdn8V gV0LyIAt+zoPXWPr1CodzK+cfFNBbM1YS54YJkWD5dxPmLVKuP1/+v0XNxQ3SJmM 4tTL/I6VzFyQtmCkYPo8DOE0ugdkFtO1IX2vfbStFGV7fINe53AKMXXAmXrbv5QM LeGuzS6ELj2RxuPSm00wTA==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t=1713832005; x= 1713918405; bh=4UxVo9NXXFAGCyxnku4sudL1IS2yoVvqiOTpyvx/Q3o=; b=P TZcQAJ85sYGXJ+8iiHjXfms6awFjO5M/8RKh/sSwlpG8mb9q7M8+2J7FtpwzycRB oj53sZzukH54YI92tgWrr9M8gpyzhY73GQ3DSyyTXuSh3j5fPOTiV6A8HIg8YuNi w9Nlr77ewXWlx7F+sFobhK/8CIL7mhuIZ4Ec8NF9EsJKpMmlOWqRgG1dUhAvpomG evxzfLJLSxb8Hfh69WgjTV6y++81SbN3Bzx93GOTxTXxYUPCqwc04RdbQLmKFLmL CezmHKToYbl1UjMRv6uWyLVnlLK4iDsYNYQtng34EvxhYt747P6Ctj/tkN9bqlE8 SFfJXsOgTbMpBCBWSMekA==
X-ME-Sender: <xms:RAAnZpMIefSfZuIoJq9uD8swwSLuVERHfJs67gMBtq1QvhSfeExJGA> <xme:RAAnZr_Utn70oIkFesscOmz7-s_mf5pucVBTTF4o5WExOf_4iScftctxaEQVowq3X 4EJsrLW2xTNVMNq4g>
X-ME-Received: <xmr:RAAnZoSHcPDlvyKcdxIiBVUrQZmHu9tTH53wXCSWupbv4DMtm9Jl9uYCgucHWOsETn5Cv1SZNVME2dwUgUkRCnWmkGnvddS-UDBhY--a6nvwUS3W1IpWF1wF>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrudeltddgfeeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurheptggguffhjgffvefgkfhfvffosehtqhhmtdhhtdejnecuhfhrohhmpeforghr khcupfhothhtihhnghhhrghmuceomhhnohhtsehmnhhothdrnhgvtheqnecuggftrfgrth htvghrnheptddutedufeevffduleeutdekgeeltdfghfefjeehuddvgfeuffelhfethfff gefhnecuffhomhgrihhnpehmvghsuhhrrdhiohdpmhhnohhtrdhnvghtpdhivghtfhdroh hrghenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehm nhhothesmhhnohhtrdhnvght
X-ME-Proxy: <xmx:RAAnZlu3PSSXbpzfpxQImzlxNIKIp3_8rLmzGtEyAtuooBeWvm-0bw> <xmx:RAAnZheYKg-ERXIs3vMAUBHnnvABRZurJQS6t8y_NYBdenFINR61bQ> <xmx:RAAnZh0I4mGNDr_RYWFLS0DIiHNuwzspUkBouvJ9rEVIQFDsxAwGjg> <xmx:RAAnZt8T4dOfHvSawanNK92zg9N2hvGfsjbdfD6yDrpP291FrBtdMA> <xmx:RQAnZl50BhY8y2N2SGIRzH95jddbqfylrCR5LLqtWfOoIvaFgOrhUYou>
Feedback-ID: ie6694242:Fastmail
Received: by mail.messagingengine.com (Postfix) with ESMTPA; Mon, 22 Apr 2024 20:26:43 -0400 (EDT)
Content-Type: text/plain; charset="utf-8"
Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.500.171.1.1\))
From: Mark Nottingham <mnot@mnot.net>
In-Reply-To: <CAGJKSNQoDX0=h_-2efTtAdh2Ubk8WSs7sfF=AXLkmGU6GVKYmA@mail.gmail.com>
Date: Tue, 23 Apr 2024 10:26:40 +1000
Cc: ai-control@ietf.org
Content-Transfer-Encoding: quoted-printable
Message-Id: <C90C7A5B-961C-467F-B0BA-8076420D3D99@mnot.net>
References: <66D05E57-6474-414D-AF4C-409B063E970F@mnot.net> <CAGJKSNQoDX0=h_-2efTtAdh2Ubk8WSs7sfF=AXLkmGU6GVKYmA@mail.gmail.com>
To: Michael Prorock <mprorock@mesur.io>
X-Mailer: Apple Mail (2.3774.500.171.1.1)
Archived-At: <https://mailarchive.ietf.org/arch/msg/ai-control/n4pkjSAHGtOX-Vs_BisOknSD-uQ>
Subject: Re: [ai-control] Considerations for AI Opt-Out
X-BeenThere: ai-control@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: AI Control <ai-control.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ai-control>, <mailto:ai-control-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ai-control/>
List-Post: <mailto:ai-control@ietf.org>
List-Help: <mailto:ai-control-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ai-control>, <mailto:ai-control-request@ietf.org?subject=subscribe>
X-List-Received-Date: Tue, 23 Apr 2024 00:26:51 -0000

Hi Mike,

It's a good question -- I think it points out the need to be nuanced in whatever standard emerges, but also that the format needs to be extensible and flexible enough to accommodate changes to uses over time, since "AI" is still very young.

Cheers,


> On 23 Apr 2024, at 04:45, Michael Prorock <mprorock@mesur.io> wrote:
> 
> Mark,
> Thanks for this. Very well thought out.
> Question, as we see more and more RAG focused approaches that blur the line between traditional search (which in theory benefits crawled sites) and generative AI crawling just for training content, how does that play out, if at all from your perspective?  
> 
> Mike Prorock
> Founder
> https://mesur.io/
> 
> 
> 
> On Sun, Apr 21, 2024 at 6:04 PM Mark Nottingham <mnot@mnot.net> wrote:
> I've written down a few thoughts about how appropriate it is to use robots.txt for opt-out:
>   https://www.mnot.net/blog/2024/04/21/ai-control
> 
> I'd be interested to hear what people think.
> 
> Cheers,
> 
> --
> Mark Nottingham   https://www.mnot.net/
> 
> -- 
> ai-control mailing list
> ai-control@ietf.org
> https://www.ietf.org/mailman/listinfo/ai-control

--
Mark Nottingham   https://www.mnot.net/