Icon of roboxt!

roboxt! 1.0.7

by Nikolas Schmidt-Voigt

The Firefox Add-On roboxt! helps determing if robots.txt is configured correctly. It reports which pages a web crawler may crawl and marks links that a web crawler may not visit.