
robots.txt Detection by Werner
Check whether a website has robots.txt. After configuration, this extension can detect whether other paths exist.
15 Users15 Users
Extension Metadata
Screenshots




Permissions and dataLearn more
Required permissions:
- Access browser tabs
- Access your data for all web sites
More information
- Add-on Links
- Version
- 0.3
- Size
- 49.7 kB
- Last updated
- 6 years ago (16 Nov 2019)
- Related Categories
- Licence
- Mozilla Public Licence 2.0
- Version History
- Add to collection