Added
- Support
waitForfor crawler.queue()'s options. - Support
slowMofor HCCrawler.connect()'s options.
Fixed
- Fix a bug of not allowed to set
timeoutoption per request. - Fix a bug of crawling twice if one url has a trailing slash on the root folder and the other does not.