robots.txt Detection by Werner
Check whether a website has robots.txt. After configuration, this extension can detect whether other paths exist.
18 Users18 Users
Extension Metadata
Screenshots
Permissions and data
More information
- Add-on Links
- Version
- 0.3
- Size
- 49.7 kB
- Last updated
- 6 years ago (16 Nov 2019)
- Related Categories
- Licence
- Mozilla Public Licence 2.0
- Version History
- Add to collection