You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A **web crawler** is a program, often called a bot or robot, which systematically browses the {{glossary("World Wide Web","Web")}} to collect data from webpages. Typically search engines (e.g. Google, Bing, etc.) use crawlers to build indexes.
## See also
- Related glossary terms:
- {{Glossary("Search engine")}}
-[Web crawler](https://en.wikipedia.org/wiki/Web_crawler) on Wikipedia