Disallow all search engines to crawl the specified directories - /images and /cgi-bin:
User-agent: *
Disallow: /cgi-bin/
Disallow: /images/
User-agent: *
Disallow: /cgi-bin/
Disallow: /images/
by KFM December 23, 2004
Get the robots.txt neck gaiter and mug.
by Mr.Crybik December 04, 2019
Get a robots.txt mug for your cat Julia.
Apr 21 trending
- 1. Watermelon Sugar
- 2. Ghetto Spread
- 3. Girls who eat carrots
- 4. sorority squat
- 5. Durk
- 6. Momala
- 7. knocking
- 8. Dog shot
- 9. sputnik
- 10. guvy
- 11. knockin'
- 12. nuke the fridge
- 13. obnoxion
- 14. Eee-o eleven
- 15. edward 40 hands
- 16. heels up
- 17. columbus
- 18. ain't got
- 19. UrbDic
- 20. yak shaving
- 21. Rush B Cyka Blyat
- 22. Pimp Nails
- 23. Backpedaling
- 24. Anol
- 25. got that
- 26. by the way
- 27. Wetter than an otter's pocket
- 28. soy face
- 29. TSIF
- 30. georgia rose
