AI

Bill Gates-backed Vicarious Surgical adds a virtual reality twist to robots in the operating room

Comment

Image Credits: PRImageFactory (opens in a new window) / Getty Images

In an operating room in rural Idaho, doctors prep a patient for surgery. They make a tiny, thumb-sized incision into the patient and insert a small robot while across the country a surgeon puts on a virtual reality headset, grabs their controllers and prepares to operate.

While this scene may seem like science fiction now, a Charlestown, Mass.-based startup called Vicarious Surgical is developing the technology to make that vision a reality.

The company’s co-founders, Adam Sachs and Sammy Khalifa, have been developing and refining the technology almost since they met at the Massachusetts Institute of Technology as undergraduates.

The 27-year-old Sachs said that he and Khalifa formally launched the company roughly five years ago when they graduated from MIT, and have been working on it ever since.

“We’ve been working on ways to miniaturize robotics and put all of the motion of surgery into the abdominal cavity,” says Sachs. “If you put all of the motion inside the abdominal cavity you are not confined to motion around the incision sites.”

What really set the founders’ brains buzzing was the potential for combining their miniature robots with the ability to see inside the body using virtual reality headsets like the Oculus Rift.

“It wasn’t a ‘Eureka!’ moment, but more like two-or-three weeks as the vision came together,” says Sachs. “We can make robotics more human-like and virtual reality would give you that presence in the body.”

The two founders initially bootstrapped their startup and then raised a small seed round, then began steadily closing larger tranches of a rolling round from luminaries like Bill Gates through his Gates Frontier fund, Khosla Ventures, Eric Schmidt’s Innovation Endeavors, AME Cloud Ventures (investment firm from Yahoo founder Jerry Yang), Singularity Holdings investor Neil Devani and Salesforce founder Marc Benioff.

In all, the company has raised some $31.8 million to support the development of its technology.

For Sachs and Khalifa, even though the technology was broadly applicable in areas that would yield faster results than healthcare, tackling the health market first was important, Sachs says.

A lot of people pointed out that our technology has a lot of applications. [But] healthcare for all of the reasons that people talk about really is meaningful to us,” says Sachs. “I have the luxury of being able to work on a project that’s fascinating from a technology standpoint and meaningful from a social good aspect.”

Vicarious Surgical chief medical officer Dr. Barry Greene (left), chief executive, Adam Sachs (middle), and chief technology officer, Sammy Khalifa (right)

Science and entrepreneurship runs in the Sachs family. Adam’s father, Ely Sachs, is a professor at MIT and one of the co-founders of the revolutionary 3D-printing company, Desktop Metal.

According to Sachs, a number of innovations in robotics has led the company to develop what Sachs calls tiny humanoid robots. 

Picture a very robotic version of two human arms and a human head,” says Sachs. “Two robotic arms that have the same degrees of freedom and proportions of a human arms and a camera that is placed above the shoulders of the robot… it’s a few inches across.”

Using the motorized robot a surgeon can remotely control the robot’s movements to operate on a patient. “They can be in another room or they can be hundreds of miles away (with an excellent internet connection,” says Sachs. 

For surgeons using Vicarious’ technology, the primary feedback is virtual, Sachs says. They look through the “eyes” of the robot and can look down and see the robot’s arms. “We track the surgeon’s arm motion and mimics their arms and hands. The primary feedback is to create the impression of presence of the surgeon as if they’d been shrunk down.”

The mission of Vicarious Surgical’s founders and its investors is to drive down both the cost of higher impact surgeries and access to the best surgeons through remote technologies.

The market for medical robots is highly lucrative. Earlier today, Johnson & Johnson announced the $3.4 billion acquisition of Auris Health — a maker of robotic diagnostics and surgical tools. In all, estimates put the robotic surgery market at somewhere around $90 billion, according to a report from Allied Market Research.

“We like to invest in things that if they work they truly change the industry. Minimally invasive surgeries and surgical robotics is definitely the future and it’s just getting started,” says Dror Berman, a managing director with Innovation Endeavors.

There were 900,000 surgeries done using surgical robotics out of a total of 313 million surgical procedures. It’s a low percentage and it’s very expensive to buy those… In general that’s not offered to the vast majority of patients. Vicarious is about democratizing that access… if it works it will open a huge market for people who can use much better procedures for much better surgeries,” Berman says. 

J&J spends $3.4 billion in cash for Auris Health’s lung cancer diagnostics and surgical robots

“One of the problems with that is that smaller hospitals can’t afford these $2 million robots,” says Sachs. “By making the devices tiny and fitting the motion inside a patient we can expand access long-term and in smaller hospitals where a surgeon might be able to start a procedure.”

Later, as Vicarious is able to build up taxonomies of different surgical practices and methods, the hospitals could begin to automate more aspects of the procedures to the point where many of these surgeries may just be handled by the robot.

The company is currently testing its miniature robots in laboratories and would not comment on whether it was using animal subjects. Vicarious is also modeling the human abdomen and conducting as many virtual tests as possible.

The new funding, Sachs says, will take the company through its applications for the Food and Drug Administration.

“A lot of our long-term vision is about growing and scaling our technology to the point where it’s accessible not just to big cities and major hospitals in the U.S. and also the small cities and towns in the rural U.S. and around the world as well,” says Sachs. “Long-term it’s about the democratization of surgery that can come from surgical robotics.”

More TechCrunch

Hello, and welcome back to TechCrunch Space. In case you missed it, Boeing and NASA decided to keep Starliner docked to the International Space Station for the rest of the…

TechCrunch Space: Catching stars

As failed EV startup Fisker winds its way through bankruptcy, a persistent and tricky question has become a flashpoint of the proceedings: does its lone secured lender Heights Capital Management…

The question haunting Fisker’s bankruptcy

So-called “unlearning” techniques are used to make a generative AI model forget specific and undesirable info it picked up from training data, like sensitive private data or copyrighted material. But…

Making AI models ‘forget’ undesirable data hurts their performance

Uber is now letting riders in India to book up to three rides simultaneously.

Uber now lets users in India book three trips at once

U.S. airports are rolling out facial recognition to scan travelers’ faces before boarding their flights. Americans, at least, can opt out. 

How to opt out of facial recognition at airports (if you’re American)

The promise of AI and large language models (LLMs) is the ability to understand increasingly wider amounts of context and make sense of that information easily, so it makes sense…

Bee AI raises $7M for its wearable AI assistant that learns from your conversations

Featured Article

DEI backlash: Stay up-to-date on the latest legal and corporate challenges

It’s clear that this year will be a turning point for DEI.

DEI backlash: Stay up-to-date on the latest legal and corporate challenges

Bike-taxi startup Rapido, which counts Swiggy among its investors, is the latest Indian firm to become a unicorn.

India’s Rapido becomes a unicorn with fresh $120M funding

Government websites aren’t known for cutting-edge tech. GovWell co-founder and CTO Ben Cohen discovered this while trying to help his dad, a contractor, apply for building permits. Cohen worked as…

GovWell is bringing automation and efficiency to local governments

Critics have long argued that wararantless device searches at the U.S. border are unconstitutional and violate the Fourth Amendment.

US border agents must get warrant before cell phone searches, federal court rules

Featured Article

UK’s Zapp EV plans to expand globally with an early start in India

Zapp is launching its urban electric two-wheeler in India in 2025 as it plans to expand globally.

UK’s Zapp EV plans to expand globally with an early start in India

The first time I saw Google’s latest commercial, I wondered, “Is it just me, or is this kind of bad?” By the fourth or fifth time I saw it, I’d…

Dear Google, who wants an AI-written fan letter?

Featured Article

MatPat, the first big YouTuber to successfully exit his company, is lobbying for creators on Capitol Hill

Though MatPat retired from YouTube, he’s still pretty busy. In fact, he’s been spending a lot of time on Capitol Hill.

MatPat, the first big YouTuber to successfully exit his company, is lobbying for creators on Capitol Hill

Featured Article

A tale of two foldables

Samsung is still foldables’ 500-pound gorilla, but the company successes have made the category significantly less lonely in recent years.

A tale of two foldables

The California Department of Motor Vehicles this week granted Nuro approval to test its third-generation R3 autonomous delivery vehicle in four Bay Area cities, giving the AV startup a positive…

Autonomous delivery startup Nuro is gearing up for a comeback

With Ghostery turning 15 years old this month, TechCrunch caught up with CEO Jean-Paul Schmetz to discuss the company’s strategy and the state of ad tracking.

Ghostery’s CEO says regulation won’t save us from ad trackers

Two years ago, workers at an Apple Store in Towson, Maryland, were the first to establish a formally recognized union at an Apple retail store in the United States. Now…

Apple reaches its first contract agreement with a US retail union

OpenAI is testing SearchGPT, a new AI search experience to compete directly with Google. The feature aims to elevate search queries with “timely answers” from across the internet and allows…

OpenAI comes for Google with SearchGPT

Indian cryptocurrency exchange WazirX announced on Saturday a controversial plan to “socialize” the $230 million loss from its recent security breach among all its customers, a move that has sent…

WazirX to ‘socialize’ $230M security breach loss among customers

Featured Article

Stay up-to-date on the amount of venture dollars going to underrepresented founders

Stay up-to-date on the latest funding news for Black and women founders.

Stay up-to-date on the amount of venture dollars going to underrepresented founders

The National Institute of Standards and Technology (NIST), the U.S. Commerce Department agency that develops and tests tech for the U.S. government, companies and the broader public, has re-released a…

NIST releases a tool for testing AI model risk

Featured Article

Max Space reinvents expandable habitats with a 17th-century twist, launching in 2026

Max Space’s expandable habitats promise to be larger, stronger, and more versatile than anything like them ever launched, not to mention cheaper and lighter by far than a solid, machined structure.

Max Space reinvents expandable habitats with a 17th-century twist, launching in 2026

Payments giant Stripe has acquired a four-year-old competitor, Lemon Squeezy, the latter company announced Friday. Terms of the deal were not disclosed. As a merchant of record, Lemon Squeezy calculates…

Stripe acquires payment processing startup Lemon Squeezy

iCloud Private Relay has not been working for some Apple users across major markets, including the U.S., Europe, India and Japan.

Apple reports iCloud Private Relay global outages for some users

Welcome to Startups Weekly — your weekly recap of everything you can’t miss from the world of startups. To get Startups Weekly in your inbox every Friday, sign up here. This…

Legal tech, VC brawls and saying no to big offers

Apple joins 15 other tech companies — including Google, Meta, Microsoft and OpenAI — that committed to the White House’s rules for developing generative AI.

Apple signs the White House’s commitment to AI safety

The language is ambiguous, so it’s not clear whether X is helping itself to all user data for training Grok or whether this processing refers only to user interactions with…

Privacy watchdog says it’s ‘surprised’ by Elon Musk opting user data into Grok AI training

Sound Search on TikTok is somewhat similar to YouTube Music’s song detection tool that lets you find the name of a song by singing, humming or playing it. 

TikTok rolls out a new feature that lets you find songs by singing or humming them

Skip, a wearable tech startup that began as a secretive project inside Alphabet, exited stealth this week to announce a partnership with outdoor clothing specialist Arc’teryx. The deal is the…

Alphabet X spinoff partners with Arc’teryx to bring ‘everyday’ exoskeleton to market

Ledger, a French startup mostly known for its secure crypto hardware wallets, has launched a new mid-range device, the Ledger Flex. Available now, priced at $249, the dinky hardware wallet…

Ledger launches Ledger Flex, a mid-range hardware crypto wallet