database of robots.txt-derived permissions
http://search.cpan.org/dist/WWW-RobotRules/
This module parses _/robots.txt_ files as specified in "A Standard for
Robot Exclusion", at Webmasters
can use the _/robots.txt_ file to forbid conforming robots from accessing
parts of their web site.
- Developed at devel:languages:perl
- Sources inherited from project openSUSE:Factory
-
4
derived packages
- Download package
-
Checkout Package
osc -A https://api.opensuse.org checkout openSUSE:Backports:SLE-15-SP4:FactoryCandidates/perl-WWW-RobotRules && cd $_ - Create Badge
Refresh
Refresh
Source Files
| Filename | Size | Changed |
|---|---|---|
| WWW-RobotRules-6.01.tar.gz | 0000009047 8.83 KB | |
| perl-WWW-RobotRules.changes | 0000000174 174 Bytes | |
| perl-WWW-RobotRules.spec | 0000002042 1.99 KB |
Revision 3 (latest revision is 9)
Adrian Schröter (adrianSuSE)
committed
(revision 3)
Comments 0