Social

Meta filmed Mr Beast, Paris Hilton and 26 more to build celebrity AIs based on Llama 2

Comment

Snoop Dogg as dungeon master at Meta Connect 2023
Image Credits: Meta

Actors are in the middle of a major, protracted battle with Hollywood over what role AI will be playing in the future of entertainment, and how they’ll be compensated for that when those AIs are basically likenesses of them. Over at Meta, it looks like some of those kinks have been ironed out…

Today, the parent of Facebook, Instagram, WhatsApp (and a bunch of other products it hopes will, one day, become as successful as these) unveiled a new set of celebrity AIs: 28 AI characters based on famous people — built in cooperation with those celebs but running entirely on AI — from across the worlds of sport, music, social media and more.

The list is a who’s-who of personalities that spin the media wheels of the western world, including the likes of Tom Brady, Charli D’Amelio, Snoop Dog and Paris Hilton. The idea here is that Meta’s version of them, these AIs — which Facebook tells me are built on Llama 2 — can be called into conversations with users across all of Meta’s various platforms (chats, VR experiences and so on), where they will give you fun and helpful advice in their areas of expertise.

Tom Brady’s Bru (not Bro) will chew the fat about sports; Charli’s Coco will help you dance; Kendall Jenner’s Billie will give you “ride or die” advice. Some are a little more left field. Paris plays Amber (a character of a character), who will help you solve whodunits, and… Snoop is NOT helping you craft music or build hydroponic enterprises; he is a, um, “Dungeon Master.”

For now, Meta is being somewhat cagey on all of the details behind how the celebrity characters were built. Here’s what we know and don’t know:

— The company confirmed to us that they are built on the Llama 2 large language model that was released earlier this year.

— These are not video clips, but generated AI animations: Meta filmed the people that the AIs represent, and then used “generative techniques” to turn those disparate animations into cohesive user experiences. The aim of the model is to preserve a “unique personality and tone” for each character, while also making sure each provided useful information. It declined to comment on whether it filmed just the people in question, or whether clips of others were used to supplement the footage.

— That also included what Mark Zuckerberg described onstage as “thousands of hours” of red-teaming and working with prompts to train the characters to steer clear of iffy topics, and so that the video interactions matched up with the text-based responses when the conversations are in chats.

— The chat aspect is important: There is no audio for now, although that is apparently coming next year. I can’t help but wonder: Will it be more successful than Amazon’s celebrity Alexa voices, which it shut down earlier this year?

— Absolutely no detail on the business model behind this. We asked how Meta was compensating the celebrities for their likenesses, which got a resounding “no comment” from the spokespeople.

But, when you consider some of the existing Meta business — where for example Instagram has a fairly well-established model for paying creators; and the whole company is largely run on advertising revenues — you might already be able to hear the spiel. These characters will appear across multiple social platforms and interfaces (mobile, web, VR). And influencers and other media personalities will be able to use them to stay “authentic” to their brands, while also letting Kendall Inc. scale up Kendall’s output and “engagement.”

We’re only starting to get to grips with how AI can trick us into thinking we’re looking or listening to real-world humans doing human things, when in reality we’re looking at likenesses. Sadly, there is no real Pope rocking Balenciaga, and there is no new Drake track.

So when the “characters” were first unveiled by Zuckerberg during the keynote today, it was hard to get a sense of what we were looking at. Are these video clips? Is the AI character really responding to what Zuck was writing? Unlike the help Meta thinks you might get from its chatbots one day, the live demo featuring a nodding and smiling Snoop Dog acting as “Dungeon Master” did nothing to help answer these questions. (“Note: text RPGs make for exceptionally boring and awkward onstage demos,” one of my colleagues quipped in Slack.) 

If there was an overriding message from today’s AI news it was this: Leave your dystopia at the door! Meta often has a knack for pulling the uncanny carpet out from under us, and that’s what it’s aiming for here, playing on the wow factor. We want to know these people, and now, every one of us can converse with Tom, Kendall and Paris — and Meta can build a full-on experience, and maybe even a business, out of that.

Read more about Meta Connect on TechCrunch

More TechCrunch

A fireside chat on Monday between Nvidia CEO Jensen Huang and Meta CEO Mark Zuckerberg at the SIGGRAPH 2024 conference in Colorado took a few unexpected turns. It started innocently…

Huang and Zuckerberg swapped jackets at SIGGRAPH 2024 and things got weird

Meta’s machine learning model, Segment Anything, has a sequel: It now takes the model to the video domain, showing how fast the field is moving.

Zuckerberg touts Meta’s latest video vision AI with Nvidia CEO Jensen Huang

Featured Article

The fall of EV startup Fisker: A comprehensive timeline

Here is a timeline of the events that led fledgling automaker Fisker to file for bankruptcy.

The fall of EV startup Fisker: A comprehensive timeline

Hello, and welcome back to TechCrunch Space. In case you missed it, Boeing and NASA decided to keep Starliner docked to the International Space Station for the rest of the…

TechCrunch Space: Catching stars

As failed EV startup Fisker winds its way through bankruptcy, a persistent and tricky question has become a flashpoint of the proceedings: does its only secured lender, Heights Capital Management,…

The question haunting Fisker’s bankruptcy

So-called “unlearning” techniques are used to make a generative AI model forget specific and undesirable info it picked up from training data, like sensitive private data or copyrighted material. But…

Making AI models ‘forget’ undesirable data hurts their performance

Uber is now letting riders in India to book up to three rides simultaneously.

Uber now lets users in India book three trips at once

U.S. airports are rolling out facial recognition to scan travelers’ faces before boarding their flights. Americans, at least, can opt out. 

How to opt out of facial recognition at airports (if you’re American)

The promise of AI and large language models (LLMs) is the ability to understand increasingly wider amounts of context and make sense of that information easily, so it makes sense…

Bee AI raises $7M for its wearable AI assistant that learns from your conversations

Featured Article

DEI backlash: Stay up-to-date on the latest legal and corporate challenges

It’s clear that this year will be a turning point for DEI.

DEI backlash: Stay up-to-date on the latest legal and corporate challenges

Bike-taxi startup Rapido, which counts Swiggy among its investors, is the latest Indian firm to become a unicorn.

India’s Rapido becomes a unicorn with fresh $120M funding

Government websites aren’t known for cutting-edge tech. GovWell co-founder and CTO Ben Cohen discovered this while trying to help his dad, a contractor, apply for building permits. Cohen worked as…

GovWell is bringing automation and efficiency to local governments

Critics have long argued that wararantless device searches at the U.S. border are unconstitutional and violate the Fourth Amendment.

US border agents must get warrant before cell phone searches, federal court rules

Featured Article

UK’s Zapp EV plans to expand globally with an early start in India

Zapp is launching its urban electric two-wheeler in India in 2025 as it plans to expand globally.

UK’s Zapp EV plans to expand globally with an early start in India

The first time I saw Google’s latest commercial, I wondered, “Is it just me, or is this kind of bad?” By the fourth or fifth time I saw it, I’d…

Dear Google, who wants an AI-written fan letter?

Featured Article

MatPat, the first big YouTuber to successfully exit his company, is lobbying for creators on Capitol Hill

Though MatPat retired from YouTube, he’s still pretty busy. In fact, he’s been spending a lot of time on Capitol Hill.

MatPat, the first big YouTuber to successfully exit his company, is lobbying for creators on Capitol Hill

Featured Article

A tale of two foldables

Samsung is still foldables’ 500-pound gorilla, but the company successes have made the category significantly less lonely in recent years.

A tale of two foldables

The California Department of Motor Vehicles this week granted Nuro approval to test its third-generation R3 autonomous delivery vehicle in four Bay Area cities, giving the AV startup a positive…

Autonomous delivery startup Nuro is gearing up for a comeback

With Ghostery turning 15 years old this month, TechCrunch caught up with CEO Jean-Paul Schmetz to discuss the company’s strategy and the state of ad tracking.

Ghostery’s CEO says regulation won’t save us from ad trackers

Two years ago, workers at an Apple Store in Towson, Maryland, were the first to establish a formally recognized union at an Apple retail store in the United States. Now…

Apple reaches its first contract agreement with a US retail union

OpenAI is testing SearchGPT, a new AI search experience to compete directly with Google. The feature aims to elevate search queries with “timely answers” from across the internet and allows…

OpenAI comes for Google with SearchGPT

Indian cryptocurrency exchange WazirX announced on Saturday a controversial plan to “socialize” the $230 million loss from its recent security breach among all its customers, a move that has sent…

WazirX to ‘socialize’ $230M security breach loss among customers

Featured Article

Stay up-to-date on the amount of venture dollars going to underrepresented founders

Stay up-to-date on the latest funding news for Black and women founders.

Stay up-to-date on the amount of venture dollars going to underrepresented founders

The National Institute of Standards and Technology (NIST), the U.S. Commerce Department agency that develops and tests tech for the U.S. government, companies and the broader public, has re-released a…

NIST releases a tool for testing AI model risk

Featured Article

Max Space reinvents expandable habitats with a 17th-century twist, launching in 2026

Max Space’s expandable habitats promise to be larger, stronger, and more versatile than anything like them ever launched, not to mention cheaper and lighter by far than a solid, machined structure.

Max Space reinvents expandable habitats with a 17th-century twist, launching in 2026

Payments giant Stripe has acquired a four-year-old competitor, Lemon Squeezy, the latter company announced Friday. Terms of the deal were not disclosed. As a merchant of record, Lemon Squeezy calculates…

Stripe acquires payment processing startup Lemon Squeezy

iCloud Private Relay has not been working for some Apple users across major markets, including the U.S., Europe, India and Japan.

Apple reports iCloud Private Relay global outages for some users

Welcome to Startups Weekly — your weekly recap of everything you can’t miss from the world of startups. To get Startups Weekly in your inbox every Friday, sign up here. This…

Legal tech, VC brawls and saying no to big offers

Apple joins 15 other tech companies — including Google, Meta, Microsoft and OpenAI — that committed to the White House’s rules for developing generative AI.

Apple signs the White House’s commitment to AI safety

The language is ambiguous, so it’s not clear whether X is helping itself to all user data for training Grok or whether this processing refers only to user interactions with…

Privacy watchdog says it’s ‘surprised’ by Elon Musk opting user data into Grok AI training