What does crawler mean?
noun, verb
A computer program that systematically browses and indexes the web by retrieving and scanning web pages, or a person who crawls on their hands and knees.
Example
"The search engine uses a crawler to index new web pages and update its database."
Definition generated by AI and curated by RJS Tech Solutions LLP.