database of robots.txt-derived permissions
http://search.cpan.org/dist/WWW-RobotRules/
This module parses _/robots.txt_ files as specified in "A Standard for
Robot Exclusion", at Webmasters
can use the _/robots.txt_ file to forbid conforming robots from accessing
parts of their web site.
- Links to openSUSE:Leap:42.3 / perl-WWW-RobotRules
- Download package
-
Checkout Package
osc -A https://api.opensuse.org checkout openSUSE:Leap:42.3:Rings:1-MinimalX/perl-WWW-RobotRules && cd $_
- Create Badge
Refresh
Refresh
Source Files
Filename | Size | Changed |
---|---|---|
WWW-RobotRules-6.02.tar.gz | 0000009059 8.85 KB | |
perl-WWW-RobotRules.changes | 0000000344 344 Bytes | |
perl-WWW-RobotRules.spec | 0000002918 2.85 KB |
Revision 2 (latest revision is 3)
Ludwig Nussel (lnussel_factory)
committed
(revision 2)
branch from 42.2
Comments 0