Social

More bad news for Elon Musk after X user’s legal challenge to shadowban prevails

Comment

X logo impaling twitter bird logo
Image Credits: Bryce Durbin / TechCrunch

It’s shaping up to be a terrible, no good, really bad news month for the company formerly known as Twitter. Elon Musk’s X has just been hit with a first clutch of grievances by the European Union for suspected breaches of the bloc’s Digital Services Act — an online governance and content moderation rulebook that features penalties of up to 6% of global annual turnover for confirmed violations.

But that’s not the only high-level decision that hasn’t gone Musk’s way lately. TechCrunch has learned that earlier this month X was found to have violated a number of provisions of the DSA and the bloc’s General Data Protection Regulation (GDPR), a pan-EU privacy framework where fines can reach 4% of annual turnover, following legal challenges brought by an individual after X shadowbanned his account.

X has long been accused of arbitrary shadowbanning — a particular egregious charge for a platform that claims to champion free speech.

PhD student Danny Mekić took action after he discovered X had applied visibility restrictions to his account in October last year. The company applied restrictions after he had shared a news article about an area of law he was researching, related to the bloc’s proposal to scan citizens’ private messages for child sexual abuse material (CSAM). X did not notify it had shadowbanned his account — which is one of the issues the litigation focused on.

Mekić only noticed his account had been impacted with restrictions when third parties contacted him to say they could no longer see his replies or find his account in search suggestions.

After his attempts to contact X directly to rectify the issue proved fruitless, Mekić filed a series of legal claims against X in the Netherlands under the EU Small Claims process, alleging the company had infringed key elements of the DSA, including failing to provide him with a point of contact (Article 12) to deal with his complaints; and failing to provide a statement of reasons (Article 17) for the restrictions applied to his account.

Mekić is a premium subscriber to X so he also sued the company for breach of contract.

On top of all that, after realizing he had been shadowbanned Mekić sought information from X about how it had processed his personal data — relying on the GDPR to make these data access requests. The regulation gives people in the EU a right to request a copy of information held on them, so when X failed to provide the personal information requested he had grounds for his second case: filing claims for breach of the bloc’s data protection rules.

In the DSA case, in a ruling on July 5 the court found X’s Irish subsidiary (which is actually still called Twitter) to be in breach of contract and ordered it to pay compensation for the period Mekić was deprived of the service he had paid for (just $1.87 — but the principle is priceless).

The court also ordered X to provide Mekić with a point of contact so he could communicate his complaints to the company within two weeks or face a fine of €100 per day.

On the DSA Article 17 complaint, Mekić also prevailed as the court agreed X should have sent him a statement of reasons when it shadowbanned his account. Instead he had to take the company to court to learn that an automated system had restricted his account after he shared a news article.

“I’m happy about that,” Mekić told TechCrunch. “There was a huge debate in the courtroom. Twitter said the DSA is not proportional and that shadowbans of complete accounts do not fall under DSA obligations.”

As a further kicker, the court deemed X’s general terms and conditions to be in breach of the EU’s Unfair Terms in Consumer Contracts Directive.

In the GDPR case, which the court ruled on on July 4, Mekić chalked up another series of wins. This case concerned the aforementioned data access rights but also Article 22 (automated decision making) — which states data subjects should not be subject to decisions based solely on automated processing where they have legal or significant effect.

The court agreed that the impact of X’s shadowban on Mekić was significant, finding it affected his professional visibility and potentially his employment prospects. The court therefore ordered X to provide him with meaningful information about the automated decision-making as required by the law within one month, along with the other personal information X has so far withheld, which Mekić had requested under GDPR data access rights.

If X continues to violate these data protection rules, the company is on the hook for fines of up to €4,000 per day.

X was also ordered to pay Mekić’s costs for both cases.

While the pair of rulings only concern individual complaints, they could have wider implications for enforcement of the DSA and the GDPR against X. The former is — as we’ve seen today — only just gearing up, as X gets stung with a first step of preliminary breach findings. But privacy campaigners have spent years warning the GDPR is being under-enforced against major platforms. And the strategic role core data protections should play in driving platform accountability remains far weaker than it could and should be.

“Bringing the claims was a final attempt to clarify my unjustified shadowban and get it removed,” Mekić told TechCrunch. “And, of course, I hope Twitter’s compliance with legal transparency obligations and low-threshold contact will improve to make it even better.”

“The European Commission seems to be very busy with investigations under the DSA. So far, regarding Twitter, the Commission seems to focus mainly on stricter content moderation. My appeal to the Commission is also to be mindful of the flip side: platforms should not overreach in their non-transparent content moderation practices,” he also told us.

“If you ask me, there is a simpler solution, namely, to curb algorithms on social media such as on Twitter, which are designed to maximise engagement and revenue and to bring back the chronological timelines of the heyday of Twitter and other social media platforms as standard.”

While the EU itself has a key role in enforcing the DSA’s rules on X, as is designated as a very large online platform (VLOP), its compliance with the wider general rules falls to a European member state-level oversight body: Ireland’s media regulator, Coimisiún na Meán.

Enforcement of the EU’s flagship data protection regime on Twitter/X typically falls to another Irish body, the Data Protection Commission (DPC), which is routinely accused of dragging its feet on investigating complaints about Big Tech.

Asked for information about its enforcement of various long-standing GDPR complaints against X, a spokesperson for the DPC said it could not provide a response by the time of publication.

Individuals bringing small claims against major platforms to try to get them to abide by pan-EU law is clearly suboptimal; there’s supposed to be a whole system of regulatory supervision to ensure compliance.

“On a side note, I did experience how much time and effort it takes to litigate in court,” said Mekić. “Despite the fact that in principle it can be done without a lawyer. Even so, you spend almost a year on it while the other party can outsource it to a battery of lawyers with near-infinite budgets and just ignore it in the meantime: indeed, I have never had direct contact with anyone from Twitter, they only communicate with me through lawyers.”

Asked whether he’s hopeful the outcome of his two cases will bring an end to X’s arbitrary shadowbanning for all EU users, Mekić said he doesn’t think his own success will be enough — regulatory enforcement is going to be needed for that.

“I hope so, but I’m afraid not,” he said. “There is little focus on the commercial motives behind shadowbans. If a user breaks a rule, you could temporarily block their account. That is transparent. But that also removes that user’s ad revenue for the platform. Shadowbans are a solution for that: the user is unaware of anything and continues to engage with and generate advertising revenue for the platform.”

“It would be a brave decision by social media platforms to stop applying shadow bans and only impose transparent, contestable restrictions on users. But that will presumably lead to loss of revenue. I hope Twitter will set other platforms a good example and inform users transparently about account restrictions, as required by the DSA. To do so, platforms do need to put their commercial intentions second,” said Mekić.

“It does surprise me that the Commission has not identified anything about the large-scale shadowbanning practices that users do not receive notifications about,” he added. “It happens daily on a large scale and is easier to prove than what they are focusing on now.”

X has been contacted for a response to the rulings.

More TechCrunch

The European Commission has closed a Digital Services Act (DSA) investigation of a rewards feature in TikTok Lite by accepting commitments from the social media giant to permanently withdraw the…

TikTok Lite: EU closes addictive design case after TikTok commits to not bring back rewards mechanism

Groq, a startup developing chips to run generative AI models faster than conventional processors, said on Monday that it’s raised $640 million in a new funding round led by Blackrock.…

AI chip startup Groq lands $640M to challenge Nvidia

COVID-19 pushed people to take up outdoor activities. Now, startups are helping companies and consumers keep up with demand.

From golf to hunting, a new crop of startups want to make these experiences even better

Despite increasing demand for AI safety and accountability, today’s tests and benchmarks may fall short, according to a new report. Generative AI models — models that can analyze and output…

Many safety evaluations for AI models have significant limitations

OpenAI has built a tool that could potentially catch students who cheat by asking ChatGPT to write their assignments — but according to The Wall Street Journal, the company is…

OpenAI says it’s taking a ‘deliberate approach’ to releasing tools that can detect writing from ChatGPT

Chief Product Officer Craig Saldanha says AI is already transforming the Yelp experience.

Yelp’s chief product officer talks AI and authenticity

Featured Article

Even after $1.6B in VC money, the lab-grown meat industry is facing ‘massive’ issues

Any goal that puts cultivated meat in big box grocery stores or on fast food menus in the 2020s is “unrealistic,” according to experts.

Even after $1.6B in VC money, the lab-grown meat industry is facing ‘massive’ issues

Warren Buffett’s Berkshire Hathaway cut its Apple holding by around half, to $84.2 billion, according to an SEC filing. While Apple remains the firm’s largest stock holding by far, Buffett…

Warren Buffet’s Berkshire Hathaway sells half its Apple stock

A fireside chat between Jensen Huang and Mark Zuckerberg at SIGGRAPH 2024 took some unexpected turns. What started as a conversation about the capabilities of Nvidia GPUs and Zuckerberg’s vision…

Zuckerberg and Jensen show off their friendship, while an AI necklace covets yours

We spoke to Harness CEO and founder Jyoti Bansal about his previous company, which Cisco bought for $3.7 billion in 2017.

When a big company comes after a hot startup, it’s not a slam dunk decision to sell

Dojo is Tesla’s custom-built supercomputer that’s designed to train its “Full Self-Driving” neural networks.

Tesla Dojo: Elon Musk’s big plan to build an AI supercomputer, explained

Featured Article

Trade My Spin is building a business around used Peloton equipment

Trade My Spin has pieced together a logistics network capable of offering same or next day delivery in most major cities in the continental U.S.

Trade My Spin is building a business around used Peloton equipment

Featured Article

Meet the founder who built and sold a $600M enterprise software startup from Sri Lanka

Sanjiva Weerawarana co-founded WSO2 in 2005, recently selling it for more than $600M. He sometimes drives for Uber, too.

Meet the founder who built and sold a $600M enterprise software startup from Sri Lanka

Investors are assisting startup founders earlier than ever in an effort to help them bridge the first climate tech valley of death.

Why Bill Gates’ Breakthrough Energy and other investors are scouring universities for founders

While both the DSA and DMA aim to achieve distinct things, they are best understood as a joint response to Big Tech’s market power.

DSA vs. DMA: How Europe’s twin digital regulations are hitting Big Tech

Featured Article

How the theft of 40M UK voter register records was entirely preventable

A scathing rebuke by the U.K. data protection watchdog reveals what led to the compromise of tens of millions of U.K. voters’ information.

How the theft of 40M UK voter register records was entirely preventable

Self-driving technology company Aurora Innovation was hoping to raise hundreds of millions in additional capital as it races toward a driverless commercial launch by the end of 2024. The company, which…

Self-driving truck startup Aurora Innovation raises $483M in share sale ahead of commercial launch

The U.S. Federal Trade Commission and the Justice Department are suing TikTok and ByteDance, TikTok’s parent company, with violating the Children’s Online Privacy Protection Act (COPPA). The law requires digital…

FTC and Justice Department sue TikTok over alleged child privacy violations

Welcome to Startups Weekly — your weekly recap of everything you can’t miss from the world of startups.  This week we are looking at acquisitions of small startups, two new…

Acquiring AI talent wholesale

In a big move, Character.AI co-founder and CEO Noam Shazeer is returning to Google after leaving the company in October 2021 to found the a16z-backed chatbot startup. In his previous…

Character.AI CEO Noam Shazeer returns to Google

The startup developed a two-material system that helps homes self-regulate their internal humidity.

Adept Materials’ dehumidifying paint was inspired by trees and semiconductors

When the developers replied to the July 19 email, Yelp sent a deck of pricing tiers with base pricing starting from $229 per month for a limit of 1,000 API…

Yelp’s lack of transparency around API charges angers developers

Featured Article

Cloud infrastructure revenue approached $80 billion this quarter

The cloud infrastructure market has put the doldrums of 2023 firmly behind it with another big quarter. Revenue continues to grow at a brisk pace, fueled by interest in AI. Synergy Research reports revenue totaled $79 billion for the quarter, up $14.1 billion or 22% from last year. This marked…

Cloud infrastructure revenue approached $80 billion this quarter

The pharma giant won’t say how many patients were affected by its February data breach. A count by TechCrunch confirms that over a million people are affected.

Pharma giant Cencora is alerting millions about its data breach

Payments infrastructure firm Infibeam Avenues has acquired a majority 54% stake in Rediff.com for up to $3 million, a dramatic twist of fate for the 28-year-old business that was the…

Rediff, once an internet pioneer in India, sells majority stake for $3M

The ruling confirmed an earlier decision in April from the High Court of Podgorica which rejected a request to extradite the crypto fugitive to the United States.

Terraform Labs co-founder and crypto fugitive Do Kwon set for extradition to South Korea

A day after Meta CEO Mark Zuckerberg talked about his newest social media experiment Threads reaching “almost” 200 million users on the company’s Q2 2024 earnings call, the platform has…

Meta’s Threads crosses 200 million active users

TechCrunch Disrupt 2024 will be in San Francisco on October 28–30, and we’re already excited! Disrupt brings innovation for every stage of your startup journey, and we could not bring you this…

Connect with Google Cloud, Aerospace, Qualcomm and more at Disrupt 2024

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the…

A comprehensive list of 2024 tech layoffs

Intel announced it would lay off more than 15% of its staff, or 15,000 employees, in a memo to employees on Thursday. The massive headcount is part of a large…

Intel to lay off 15,000 employees