What does spidering mean?
Spidering is the present participle of spider, a verb meaning to move or search in a spider-like way. In everyday descriptions, it can refer to a person or creature crawling across a surface with quick, irregular movements. Its established technical use is in computing: a software program “spiders” the web by following links, visiting pages, and collecting information. The word can also be used figuratively for investigating a large body of information or repeatedly searching a system. It is more vivid than the general word searching and more specific than crawling, because it suggests movement that is persistent, exploratory, and directed toward discovering what is connected to what.
verbTo move or crawl in a spider-like manner, especially over a surface or network. In computing, it refers to systematically searching and gathering information across the internet or another connected system.
- To move or crawl in a spider-like manner.
- To search or gather information systematically across the internet or another network.
"The researchers spent the night spidering the archive for references to the lost manuscript."
"A small insect was spidering across the kitchen ceiling."
"The tool spiders websites and indexes the pages it finds."
Before search engines could crawl the web, early internet pioneers used spiders to follow links from page to page.
Reviewed by Deb Chak, Editor. AI-assisted content curated by RJS Tech Solutions LLP.
Where does spidering come from?
The form is based on spider, which comes from Old English spidra, meaning a spinner or web-making creature and now also referring to the familiar arachnid. The verb spider developed later in the sense of moving or searching in a spider-like manner. The computing sense developed by analogy with a spider following links across the web. Related forms include spidery and spiderlike, while spiderweb preserves the original association with spinning and weaving.
Related word forms
How spidering is actually used
In technology, the term is usually informal or technical jargon. In general use, it is less common than 'crawling' and evokes deliberate, searching movement.
Easily confused with spidering
Spinning means rotating or twisting fibers into thread, while spidering means moving or searching in a spider-like manner.