Added
- Emit
newpageevent. - Support
deniedDomainsanddepthPriorityfor crawler.queue()'s options.
changed
- Allow
allowedDomainsoption to accept a list of regular expressions.
newpage event.deniedDomains and depthPriority for crawler.queue()'s options.allowedDomains option to accept a list of regular expressions.