What does crawler mean?
A computer program that systematically browses and indexes the web by retrieving and scanning web pages, or a person who crawls on their hands and knees.
Example
"The search engine uses a crawler to index new web pages and update its database."
Reviewed by Deb Chak, Editor. AI-assisted content curated by RJS Tech Solutions LLP.