AI

Microsoft and Meta join Google in using AI to help run their data centers

Comment

Servers in a rack
Image Credits: Ahrefs (opens in a new window)

Data centers, which drive the apps, websites and services that billions of people use every day, can be hazardous places for the workers that build and maintain them. Workers sometimes have to service a data center’s electrical equipment while it’s being energized. And they can become exposed to chemicals like chlorine, which is used as a sterilizing agent for the water circulated through liquid cooling systems for computers and servers. In June 2015, five people had to be taken to a hospital after a chlorine gas leak at an Apple data center in Maiden, North Carolina.

Data centers are safer than they used to be. But in search of forward-looking solutions, some tech giants say that they’re exploring how AI can be applied to prevent safety issues. For example, Microsoft is developing an AI system that analyzes data from a range of sources and generates alerts for data center construction and operations teams to “prevent or mitigate the impact of safety incidents.” A complementary but related system, also under development, attempts to detect and predict impacts to data center construction schedules.

“These initiatives are both in early testing phases and are expected to begin expanding into our production environments later this year,” a Microsoft spokesperson told TechCrunch via email.

Meta also claims to be investigating ways AI can anticipate how its data centers will operate under “extreme environmental conditions” that might lead to unsafe work environments. The company says that it has been developing physical models to simulate extreme conditions and introducing this data to the AI models responsible for optimizing power consumption, cooling and airflow across its servers.

“We have significant operational data from our data centers, in some areas at high frequency with built-in sensors in servers, racks and in our data halls,” a Meta spokesperson told TechCrunch. “Each server and network device, taking on different workloads, will consume different amounts of power, generate different amounts of heat and make different amounts of airflow in the data centers. Our [infrastructure] team collects all the data from each server and then develops AI models which can allocate our servers and racks in the data centers and send workloads into these servers to optimize [for] performance and efficiency.”

Of course, companies have motivations aside from safety to ensure data centers remain in peak condition. Outages are expensive — and are becoming more frequent. According to a 2020 survey by the IT Uptime Institute, an IT consulting firm, a third of data center owners and operators admitted to experiencing a major outage over the past 12 months. One in six claimed that their outage cost them more than $1 million —  up from one in ten in 2019.

Meta has more than 20 data centers in operation around the world, including new projects in Texas and Missouri estimated to cost $1.6 billion combined. Microsoft, meanwhile, manages more than 200 data centers, and says it’s on pace to build between 50 to 100 new data centers each year for the foreseeable future.

AI also promises to find opportunities for energy — and therefore cost — savings in the data centers that normally fly under the radar, another appealing aspect for corporations. In 2018, Google claimed that AI systems developed by its DeepMind affiliate were able to deliver energy savings of 30% on average compared to its data centers’ historical energy usage.

When reached for comment, DeepMind said that it had no updates to share beyond the initial announcement. IBM and Amazon didn’t respond to inquiries. But both Meta and Microsoft say they’re now using AI for similar energy-tuning purposes.

Microsoft launched AI “anomaly detection methods” in late 2021 to gauge and mitigate unusual power and water usage events within the data center, using telemetry data from electrical and mechanical devices. The company is also using AI-based approaches to identify and fix issues with power meters in the data center and to identify ideal spots to place servers in order to minimize wasted power, network and cooling capacity.

Meta, for its part, says that it has been leveraging reinforcement learning to reduce the amount of air it pumps into data centers for cooling purposes. (At a high level, reinforcement learning is a type of AI system that learns to solve a problem by trial and error.) Most of the company’s data centers use outdoor air and evaporative cooling systems, making optimizing airflow a high priority.

The reduced environmental footprint is an added benefit of energy-regulating AI systems. Data centers consumed about 1% of the global electricity demand and contributed to 0.3% of all carbon dioxide emissions in 2020, according to a report from the Environmental Investigation Agency. And the typical data center uses 3 million to 5 million gallons of water per day, the same amount of water as a city of 30,000 to 50,000 people.

Microsoft has previously said that it plans to have all of its data centers running on 100% renewable energy by 2025. Meta claimed to have achieved the feat in 2020.

More TechCrunch

The U.S. Commerce Department today issued a report in support of “open-weight” generative AI models like Meta’s Llama 3.1, but recommended the government develop “new capabilities” to monitor these models…

U.S. Commerce Department report endorses ‘open’ AI models

Shared micromobility giant Lime is piloting two new vehicles designed to appeal to women and older folks who might appreciate a lower step-through frame, smaller wheels and an upgrade from…

Lime is piloting two new e-bikes to attract more women and older riders 

Apple has published a technical paper detailing the models that it developed to power Apple Intelligence, the range of generative AI features headed to iOS, macOS and iPadOS over the…

Apple says it took a ‘responsible’ approach to training its Apple Intelligence models

A fireside chat on Monday between Nvidia CEO Jensen Huang and Meta CEO Mark Zuckerberg at the SIGGRAPH 2024 conference in Colorado took a few unexpected turns. It started innocently…

Huang and Zuckerberg swapped jackets at SIGGRAPH 2024 and things got weird

Meta’s machine learning model, Segment Anything, has a sequel: It now takes the model to the video domain, showing how fast the field is moving.

Zuckerberg touts Meta’s latest video vision AI with Nvidia CEO Jensen Huang

Featured Article

The fall of EV startup Fisker: A comprehensive timeline

Here is a timeline of the events that led fledgling automaker Fisker to file for bankruptcy.

The fall of EV startup Fisker: A comprehensive timeline

Hello, and welcome back to TechCrunch Space. In case you missed it, Boeing and NASA decided to keep Starliner docked to the International Space Station for the rest of the…

TechCrunch Space: Catching stars

As failed EV startup Fisker winds its way through bankruptcy, a persistent and tricky question has become a flashpoint of the proceedings: does its only secured lender, Heights Capital Management,…

The question haunting Fisker’s bankruptcy

So-called “unlearning” techniques are used to make a generative AI model forget specific and undesirable info it picked up from training data, like sensitive private data or copyrighted material. But…

Making AI models ‘forget’ undesirable data hurts their performance

Uber is now letting riders in India book up to three rides simultaneously.

Uber now lets users in India book three trips at once

U.S. airports are rolling out facial recognition to scan travelers’ faces before boarding their flights. Americans, at least, can opt out. 

How to opt out of facial recognition at airports (if you’re American)

The promise of AI and large language models (LLMs) is the ability to understand increasingly wider amounts of context and make sense of that information easily, so it makes sense…

Bee AI raises $7M for its wearable AI assistant that learns from your conversations

Featured Article

DEI backlash: Stay up-to-date on the latest legal and corporate challenges

It’s clear that this year will be a turning point for DEI.

DEI backlash: Stay up-to-date on the latest legal and corporate challenges

Bike-taxi startup Rapido, which counts Swiggy among its investors, is the latest Indian firm to become a unicorn.

India’s Rapido becomes a unicorn with fresh $120M funding

Government websites aren’t known for cutting-edge tech. GovWell co-founder and CTO Ben Cohen discovered this while trying to help his dad, a contractor, apply for building permits. Cohen worked as…

GovWell is bringing automation and efficiency to local governments

Critics have long argued that wararantless device searches at the U.S. border are unconstitutional and violate the Fourth Amendment.

US border agents must get warrant before cell phone searches, federal court rules

Featured Article

UK’s Zapp EV plans to expand globally with an early start in India

Zapp is launching its urban electric two-wheeler in India in 2025 as it plans to expand globally.

UK’s Zapp EV plans to expand globally with an early start in India

The first time I saw Google’s latest commercial, I wondered, “Is it just me, or is this kind of bad?” By the fourth or fifth time I saw it, I’d…

Dear Google, who wants an AI-written fan letter?

Featured Article

MatPat, the first big YouTuber to successfully exit his company, is lobbying for creators on Capitol Hill

Though MatPat retired from YouTube, he’s still pretty busy. In fact, he’s been spending a lot of time on Capitol Hill.

MatPat, the first big YouTuber to successfully exit his company, is lobbying for creators on Capitol Hill

Featured Article

A tale of two foldables

Samsung is still foldables’ 500-pound gorilla, but the company successes have made the category significantly less lonely in recent years.

A tale of two foldables

The California Department of Motor Vehicles this week granted Nuro approval to test its third-generation R3 autonomous delivery vehicle in four Bay Area cities, giving the AV startup a positive…

Autonomous delivery startup Nuro is gearing up for a comeback

With Ghostery turning 15 years old this month, TechCrunch caught up with CEO Jean-Paul Schmetz to discuss the company’s strategy and the state of ad tracking.

Ghostery’s CEO says regulation won’t save us from ad trackers

Two years ago, workers at an Apple Store in Towson, Maryland, were the first to establish a formally recognized union at an Apple retail store in the United States. Now…

Apple reaches its first contract agreement with a US retail union

OpenAI is testing SearchGPT, a new AI search experience to compete directly with Google. The feature aims to elevate search queries with “timely answers” from across the internet and allows…

OpenAI comes for Google with SearchGPT

Indian cryptocurrency exchange WazirX announced on Saturday a controversial plan to “socialize” the $230 million loss from its recent security breach among all its customers, a move that has sent…

WazirX to ‘socialize’ $230M security breach loss among customers

Featured Article

Stay up-to-date on the amount of venture dollars going to underrepresented founders

Stay up-to-date on the latest funding news for Black and women founders.

Stay up-to-date on the amount of venture dollars going to underrepresented founders

The National Institute of Standards and Technology (NIST), the U.S. Commerce Department agency that develops and tests tech for the U.S. government, companies and the broader public, has re-released a…

NIST releases a tool for testing AI model risk

Featured Article

Max Space reinvents expandable habitats with a 17th-century twist, launching in 2026

Max Space’s expandable habitats promise to be larger, stronger, and more versatile than anything like them ever launched, not to mention cheaper and lighter by far than a solid, machined structure.

Max Space reinvents expandable habitats with a 17th-century twist, launching in 2026

Payments giant Stripe has acquired a four-year-old competitor, Lemon Squeezy, the latter company announced Friday. Terms of the deal were not disclosed. As a merchant of record, Lemon Squeezy calculates…

Stripe acquires payment processing startup Lemon Squeezy

iCloud Private Relay has not been working for some Apple users across major markets, including the U.S., Europe, India and Japan.

Apple reports iCloud Private Relay global outages for some users