AI

Brilliant Labs puts AI in front of your eye with its tiny open source AR lens

Comment

Man wearing Brilliant Labs Monocle, looking down
Image Credits: Brilliant Labs

Brilliant Labs’ augmented reality wearable stands in stark contrast to Apple’s pricey, bulky, stealthy Vision Pro. The startup’s inaugural product, Monocle, is an open source, pocket-sized AR lens that can be clipped on any eyewear or held to the eye, Launched in March, Monocle has a much more accessible price tag of $349.

“Other AR and VR headsets tend to keep you around your couch at home. We are running in the exact opposite direction,” said Bobak Tavangar, CEO and co-founder of Brilliant Labs, in an interview with TechCrunch.

To integrate its AR device into people’s daily life, Singapore-based Brilliant Labs aims to embed generative AI into its compact wearable. It’s raised some money to pursue this vision. Today, the startup announced its $3 million seed funding led by Brendan Iribe, co-founder of Oculus; Adam Cheyer, co-founder of Siri; Eric Migicovsky, founder of Pebble and former partner at Y Combinator; Plug & Play Ventures; among others.

An open approach

Monocle’s open-source community has already gained a dedicated following. In March, it went viral thanks to a group of Stanford students who transformed the eyepiece into a display for GPT-4. With the ability to listen to a user’s conversation through their phone’s microphone in real time, Monocle can generate personalized support, such as offering suggestions for what to say on a date.

The computing process happens on OpenAI’s server. The responses are then transmitted through Bluetooth from the user’s phone to Monocle and projected to the lens in front of the user’s eye.

Brilliant Labs has also developed a similar application in-house. The arGPT solution, as it’s called, is able to receive sound natively through Monocle’s mic and other sensors, enabling low-latency dialogue with GPT-4.

So far, Monocle has mostly attracted developers, hackers, hobbyists and researchers experimenting with the little palm-sized device, an approach that the founder believes can unleash the potential of fusing generative AI and AR.

“There is something important about allowing people to dig into [the AR device’s] heart and understand it and play with it and share that with others, not just passively receive something that’s the closed box that a few people far away have designed for the rest of us,” he said. “We think there’s something really philosophically important there.”

The challenge, of course, is how it branches out of the initial geeky customer base and comes up with a product that appeals to the broader consumer market.

A lightweight strategy

Monocle comes with five different processors, including a hackable field-programmable gate array (FPGA) accelerator chip that handles the data coming in from the device’s camera, microphone and capacitive touch sensor. The use of low-power electronics and miniaturized electronic parts, according to the founder, allows the lens to be compact and weigh only 15 grams.

“Every other device company was doing bulky, expensive headsets. They weren’t making money out of them,” said Tavangar. “This age of AI is upon us, and from day one — even before GPT — we saw a market opportunity with computer vision.”

At this stage, a smartphone is needed to act as a point of relay between Monocle and cloud-based AI apps. In the long term, however, the goal is to create a direct connection between the hardware and the cloud, doing away with the need for a phone host.

Eventually, the company’s vision is to run deep learning models directly on its tiny AR devices, which means even lower latency and functionality even if an internet connection is lost.

Brilliant Labs’ emphasis on a lightweight design extends to its management style. Despite being established in 2019, the startup is still run solely by its three co-founders, which makes one wonder why other mixed reality device makers need hundreds if not thousands of staff. There are signs of overhiring. In February 2021, as many as 200 people were affected during a layoff at Pico, a VR company acquired by ByteDance.

Tavangar attributes his management style to his time at Apple, where he worked as a program lead. He believes that focus is key, and that success comes from choosing one idea to pursue out of hundreds of potential options.

“How do you do really lightweight, affordable, focused hardware to deliver that AI-powered experience? [We are not chasing] the graphical intensity or big field of view [but rather] the singular AI in front of the eye experience,” the founder suggested.

“That means you don’t need an army of people who are battling with Qualcomm and all of these various different vendors and engaging in really risky, low-yield R&D and production, and still selling your end device at a loss. It means that we work with technology that has high yield and factory-floor partners that are eager to work with us, in some cases, have invested in us, like our key optics manufacturer and contract manufacturer.”

Path to profitability

While Tavangar declined to disclose Monocle’s sales figures, he said Brilliant Labs makes “a fair bit of money per unit” and “the margins are really good.” The company does “quite well” just from hardware sales without any marketing efforts, he added.

The Monocle AR lens weighs only 15 grams. Image: Brilliant Labs

“This is again something I learned from Apple. If you can get the unit economics right and if your yields are 80, 90% and above at low volume, then you’ve got the operational discipline, the good foundation, and are able to start scaling and be a profitable company,” the founder said.

Case in point, the startup is currently seeing “almost 3x in terms of what we’re able to sell it for versus what it costs us to make it.” In comparison, many other mixed reality companies are selling at zero or negative margins, Tavangar said.

Aside from selling hardware, Brilliant Labs plans to layer on more services powered by large language models, which presents an opportunity to charge for the services. Brilliant Labs integrated with GPT first because it has a “well-documented API.” But the large language model is compute-intensive and the team is constantly on the look for more compressed LLMs.

“I think over time we will see how compressed the models can become even as efficiency increases. As an undercurrent to that, the hardware we make will be more powerful even as the hardware stays low power,” the founder said.

The company is on track to “far exceed” its sales target this year. It has close to 2,000 developers in its Discord community to date.

When questioned about Brilliant Labs’ competitive edge, Tavangar reckoned that the startup’s tightly integrated software and hardware ecosystem is hard to copy, not least because it has a fledgling open-source community.

The company also enjoys a data advantage, he said, as the user information collected by the sensors continues to inform the AI services running on the platform, which in turn improves user personalization. Brilliant Labs does not store any customer data on its devices or server as it’s “not interested in selling data to advertisers,” the founder noted.

Apple’s Vision Pro reignites excitement in China’s XR world

More TechCrunch

Meta’s machine learning model, Segment Anything, has a sequel: It now takes the model to the video domain, showing how fast the field is moving.

Zuckerberg touts Meta’s latest video vision AI with Nvidia CEO Jensen Huang

Featured Article

The fall of EV startup Fisker: A comprehensive timeline

Here is a timeline of the events that led fledgling automaker Fisker to file for bankruptcy.

The fall of EV startup Fisker: A comprehensive timeline

Hello, and welcome back to TechCrunch Space. In case you missed it, Boeing and NASA decided to keep Starliner docked to the International Space Station for the rest of the…

TechCrunch Space: Catching stars

As failed EV startup Fisker winds its way through bankruptcy, a persistent and tricky question has become a flashpoint of the proceedings: does its only secured lender, Heights Capital Management,…

The question haunting Fisker’s bankruptcy

So-called “unlearning” techniques are used to make a generative AI model forget specific and undesirable info it picked up from training data, like sensitive private data or copyrighted material. But…

Making AI models ‘forget’ undesirable data hurts their performance

Uber is now letting riders in India to book up to three rides simultaneously.

Uber now lets users in India book three trips at once

U.S. airports are rolling out facial recognition to scan travelers’ faces before boarding their flights. Americans, at least, can opt out. 

How to opt out of facial recognition at airports (if you’re American)

The promise of AI and large language models (LLMs) is the ability to understand increasingly wider amounts of context and make sense of that information easily, so it makes sense…

Bee AI raises $7M for its wearable AI assistant that learns from your conversations

Featured Article

DEI backlash: Stay up-to-date on the latest legal and corporate challenges

It’s clear that this year will be a turning point for DEI.

DEI backlash: Stay up-to-date on the latest legal and corporate challenges

Bike-taxi startup Rapido, which counts Swiggy among its investors, is the latest Indian firm to become a unicorn.

India’s Rapido becomes a unicorn with fresh $120M funding

Government websites aren’t known for cutting-edge tech. GovWell co-founder and CTO Ben Cohen discovered this while trying to help his dad, a contractor, apply for building permits. Cohen worked as…

GovWell is bringing automation and efficiency to local governments

Critics have long argued that wararantless device searches at the U.S. border are unconstitutional and violate the Fourth Amendment.

US border agents must get warrant before cell phone searches, federal court rules

Featured Article

UK’s Zapp EV plans to expand globally with an early start in India

Zapp is launching its urban electric two-wheeler in India in 2025 as it plans to expand globally.

UK’s Zapp EV plans to expand globally with an early start in India

The first time I saw Google’s latest commercial, I wondered, “Is it just me, or is this kind of bad?” By the fourth or fifth time I saw it, I’d…

Dear Google, who wants an AI-written fan letter?

Featured Article

MatPat, the first big YouTuber to successfully exit his company, is lobbying for creators on Capitol Hill

Though MatPat retired from YouTube, he’s still pretty busy. In fact, he’s been spending a lot of time on Capitol Hill.

MatPat, the first big YouTuber to successfully exit his company, is lobbying for creators on Capitol Hill

Featured Article

A tale of two foldables

Samsung is still foldables’ 500-pound gorilla, but the company successes have made the category significantly less lonely in recent years.

A tale of two foldables

The California Department of Motor Vehicles this week granted Nuro approval to test its third-generation R3 autonomous delivery vehicle in four Bay Area cities, giving the AV startup a positive…

Autonomous delivery startup Nuro is gearing up for a comeback

With Ghostery turning 15 years old this month, TechCrunch caught up with CEO Jean-Paul Schmetz to discuss the company’s strategy and the state of ad tracking.

Ghostery’s CEO says regulation won’t save us from ad trackers

Two years ago, workers at an Apple Store in Towson, Maryland, were the first to establish a formally recognized union at an Apple retail store in the United States. Now…

Apple reaches its first contract agreement with a US retail union

OpenAI is testing SearchGPT, a new AI search experience to compete directly with Google. The feature aims to elevate search queries with “timely answers” from across the internet and allows…

OpenAI comes for Google with SearchGPT

Indian cryptocurrency exchange WazirX announced on Saturday a controversial plan to “socialize” the $230 million loss from its recent security breach among all its customers, a move that has sent…

WazirX to ‘socialize’ $230M security breach loss among customers

Featured Article

Stay up-to-date on the amount of venture dollars going to underrepresented founders

Stay up-to-date on the latest funding news for Black and women founders.

Stay up-to-date on the amount of venture dollars going to underrepresented founders

The National Institute of Standards and Technology (NIST), the U.S. Commerce Department agency that develops and tests tech for the U.S. government, companies and the broader public, has re-released a…

NIST releases a tool for testing AI model risk

Featured Article

Max Space reinvents expandable habitats with a 17th-century twist, launching in 2026

Max Space’s expandable habitats promise to be larger, stronger, and more versatile than anything like them ever launched, not to mention cheaper and lighter by far than a solid, machined structure.

Max Space reinvents expandable habitats with a 17th-century twist, launching in 2026

Payments giant Stripe has acquired a four-year-old competitor, Lemon Squeezy, the latter company announced Friday. Terms of the deal were not disclosed. As a merchant of record, Lemon Squeezy calculates…

Stripe acquires payment processing startup Lemon Squeezy

iCloud Private Relay has not been working for some Apple users across major markets, including the U.S., Europe, India and Japan.

Apple reports iCloud Private Relay global outages for some users

Welcome to Startups Weekly — your weekly recap of everything you can’t miss from the world of startups. To get Startups Weekly in your inbox every Friday, sign up here. This…

Legal tech, VC brawls and saying no to big offers

Apple joins 15 other tech companies — including Google, Meta, Microsoft and OpenAI — that committed to the White House’s rules for developing generative AI.

Apple signs the White House’s commitment to AI safety

The language is ambiguous, so it’s not clear whether X is helping itself to all user data for training Grok or whether this processing refers only to user interactions with…

Privacy watchdog says it’s ‘surprised’ by Elon Musk opting user data into Grok AI training

Sound Search on TikTok is somewhat similar to YouTube Music’s song detection tool that lets you find the name of a song by singing, humming or playing it. 

TikTok rolls out a new feature that lets you find songs by singing or humming them