Top definition
File that stops search engines from crawling a specified page or directory.
Disallow all search engines to crawl the specified directories - /images and /cgi-bin:

User-agent: *
Disallow: /cgi-bin/
Disallow: /images/
by KFM December 23, 2004
Mug icon

The Urban Dictionary Mug

One side has the word, one side has the definition. Microwave and dishwasher safe. Lotsa space for your liquids.

Buy the mug