
robots.txt Detection by Werner
Check whether a website has robots.txt. After configuration, this extension can detect whether other paths exist.
15 Users15 Users
Extension Metadata
Screenshots




Permissions and dataLearn more
Required permissions:
- Access browser tabs
- Access your data for all websites
More information
- Add-on Links
- Version
- 0.3
- Size
- 49.7 KB
- Last updated
- 6 years ago (Nov 16, 2019)
- Related Categories
- License
- Mozilla Public License 2.0
- Version History
- Add to collection