Re: [ai-control] Considerations for AI Opt-Out

Michael Prorock <mprorock@mesur.io> Mon, 22 April 2024 18:45 UTC

Return-Path: <michael.prorock@mesur.io>
X-Original-To: ai-control@ietfa.amsl.com
Delivered-To: ai-control@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5AAEAC1840FB for <ai-control@ietfa.amsl.com>; Mon, 22 Apr 2024 11:45:28 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -6.895
X-Spam-Level:
X-Spam-Status: No, score=-6.895 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_HI=-5, RCVD_IN_ZEN_BLOCKED_OPENDNS=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URIBL_DBL_BLOCKED_OPENDNS=0.001, URIBL_ZEN_BLOCKED_OPENDNS=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=mesur-io.20230601.gappssmtp.com
Received: from mail.ietf.org ([50.223.129.194]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id aP7TskG-zgra for <ai-control@ietfa.amsl.com>; Mon, 22 Apr 2024 11:45:24 -0700 (PDT)
Received: from mail-ej1-x634.google.com (mail-ej1-x634.google.com [IPv6:2a00:1450:4864:20::634]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 0FA72C1840FA for <ai-control@ietf.org>; Mon, 22 Apr 2024 11:45:23 -0700 (PDT)
Received: by mail-ej1-x634.google.com with SMTP id a640c23a62f3a-a52aa665747so577693866b.2 for <ai-control@ietf.org>; Mon, 22 Apr 2024 11:45:23 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mesur-io.20230601.gappssmtp.com; s=20230601; t=1713811522; x=1714416322; darn=ietf.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=JJVZy76JU3nqMVVUmVQEAiqBS2MtvfhmHurjVKmkGuE=; b=OEyzchYI6q3GgfJi/2lWzqSa5nEszscZhg7+CmXTdogmm9VZE0n8TZXnnDNsLqr+su OzS1AvcvMAeIXg2ZFl8QxSWSzbGTcVjWMJfUPB1v2iPO19MgJ0u8ewMQG5d5UGBd+a23 M0l5kYuNNbrDsLe/pAqTOP1zcHUyXckAFNCbdunDcEvKEw10MSKnxczKv3wZ7njPfopg x/U/4GFE/rnJf5MxBngLF42B4mzLh0FCXE/k2M47254tNvmYqL3RIUTPNUy2T8wkFGiq 1gZuFPzK4/WFEKbD7wAvuN4c2tGVGIVvTp7JTkOemBYOC4EUaip/kxlBoKu8LW40AaqM uqHQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1713811522; x=1714416322; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=JJVZy76JU3nqMVVUmVQEAiqBS2MtvfhmHurjVKmkGuE=; b=GI7wz1H8gS88vw8TxWU8epFvM6Rts7mNeX7ImnJ/XIE6BbiaIu79tNC0hKLrg1guXj 3Mv+ImrfmXzL4tAxvM+iMd333T52YM//COQl9PVMxTLiL+Q0+4B2sKihwv35pyMtodla zuHPnggg96GGGlNMWZiA3BUC8CaVMF8C503R+TiBko/wxGVHROlKSJlgs37Nhp3qCtiK 9x3Fju2e1j8+mE1c86CYvWkBJ+yLfLK7okAtjry/A01IemKCc2sEyfdZnHkejmbuzAXC aYMPeUUxUPaEvBOQV8TNjmzcpjtNmrFMc2K3BtTEkVGldT1IIjqflhFZ556jjfP++MkR gdCg==
X-Gm-Message-State: AOJu0YzqX0AOPJVJgBWtsRoR51mq8SwOaRt+9LypkP6lqSQ9rO805syu aHIqD6T+Uyl2TmDqn8KUN8pwBA9jbyNphdC0/5+gixCZzxDx07O4qTj2QmIwK3w2Q6Sx3cQ/+I3 5sMc6QO6f+nIHx1A7j1A1HfSxyrqalIl+CeDXL62wTRKedoo=
X-Google-Smtp-Source: AGHT+IHN7XBCp6fimnMvS81ImHjUyjOJjr1ECI4X+gMNQ77HAk8So3LebVePu8mQaMuVZhBfmpNlo57crAIWCixjoiA=
X-Received: by 2002:a17:906:1917:b0:a46:df55:e238 with SMTP id a23-20020a170906191700b00a46df55e238mr5837919eje.44.1713811522155; Mon, 22 Apr 2024 11:45:22 -0700 (PDT)
MIME-Version: 1.0
References: <66D05E57-6474-414D-AF4C-409B063E970F@mnot.net>
In-Reply-To: <66D05E57-6474-414D-AF4C-409B063E970F@mnot.net>
From: Michael Prorock <mprorock@mesur.io>
Date: Mon, 22 Apr 2024 12:45:10 -0600
Message-ID: <CAGJKSNQoDX0=h_-2efTtAdh2Ubk8WSs7sfF=AXLkmGU6GVKYmA@mail.gmail.com>
To: Mark Nottingham <mnot@mnot.net>
Cc: ai-control@ietf.org
Content-Type: multipart/alternative; boundary="000000000000fd99df0616b3d6c7"
Archived-At: <https://mailarchive.ietf.org/arch/msg/ai-control/H2QWCyOYCMPeI3QiTX6pNcSjKQk>
Subject: Re: [ai-control] Considerations for AI Opt-Out
X-BeenThere: ai-control@ietf.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: AI Control <ai-control.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/ai-control>, <mailto:ai-control-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/ai-control/>
List-Post: <mailto:ai-control@ietf.org>
List-Help: <mailto:ai-control-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/ai-control>, <mailto:ai-control-request@ietf.org?subject=subscribe>
X-List-Received-Date: Mon, 22 Apr 2024 18:45:28 -0000

Mark,
Thanks for this. Very well thought out.
Question, as we see more and more RAG focused approaches that blur the line
between traditional search (which in theory benefits crawled sites) and
generative AI crawling just for training content, how does that play out,
if at all from your perspective?

Mike Prorock
Founder
https://mesur.io/



On Sun, Apr 21, 2024 at 6:04 PM Mark Nottingham <mnot@mnot.net> wrote:

> I've written down a few thoughts about how appropriate it is to use
> robots.txt for opt-out:
>   https://www.mnot.net/blog/2024/04/21/ai-control
>
> I'd be interested to hear what people think.
>
> Cheers,
>
> --
> Mark Nottingham   https://www.mnot.net/
>
> --
> ai-control mailing list
> ai-control@ietf.org
> https://www.ietf.org/mailman/listinfo/ai-control
>