robots-parser

v3.0.1

A specification compliant robots.txt parser with wildcard (*) matching support.

Install

npm install robots-parser

Bundle size

Dependencies

Dependencies(0)

Peer Dependencies(0)

Dev Dependencies(3)

chai
^4.3.6
mocha
^10.0.0
nyc
^15.1.0

Source code on GitHub