Top definition
Those little robot slaves that endlessly browse the web and save/index information about websites.

archive.org owes its entire existence to these little guys.
One of Google's webcrawlers just indexed my website penisland.com, and now EVERYONE can visit it :D
via giphy
by Fasteroid November 28, 2016
Get the mug
Get a webcrawlers mug for your Facebook friend Zora.