web scraping

Featured Article

News outlets are accusing Perplexity of plagiarism and unethical web scraping

In the age of generative AI, when chatbots can provide detailed answers to questions based on content pulled from the internet, the line between fair use and plagiarism, and between routine web scraping and unethical summarization, is a thin one.  Perplexity AI is a startup that combines a search engine…

News outlets are accusing Perplexity of plagiarism and unethical web scraping

Meta has dropped its lawsuit against Israeli web-scraping company Bright Data, after losing a key claim in its case a few weeks ago. The social networking giant has a history…

Meta drops lawsuit against web-scraping firm Bright Data that sold millions of Instagram records

Good news for archivists, academics, researchers and journalists: Scraping publicly accessible data is legal, according to a U.S. appeals court ruling. The landmark ruling by the U.S. Ninth Circuit of…

Web scraping is legal, US appeals court reaffirms

The Supreme Court has given LinkedIn another chance to stop a rival company from scraping personal information from users’ public profiles, a practice LinkedIn says should be illegal but one…

Supreme Court revives LinkedIn case to protect user data from web scrapers

Bots are ruining the internet. When they’re not pummeling a website with usernames and passwords from a long list of stolen credentials, they’re scraping the price of hotels or train…

Bots are cheap and effective. One startup trolls them into going away

With a new $10 million commitment led by Tencent, one of China’s largest Internet companies, Diffbot chief executive Mike Tung has come a long way from his days of eating…

Diffbot Aims To Build The Intel Of Data For Artificial Intelligence

Distil.it, a cloud-based platform that aims to help businesses quash web scraping and other nefarious web-born fraud, announced today that it has landed $1.8 million in seed financing. Investors in…

TechStars Grad Distil.It Lands $1.8M To Help Your Business Put A Stop To Bots, Web Scraping & Content Theft