Added
- Support CSV and JSON Lines formats for exporting results
- Emit
requeststarted,requestskipped,requestfinished,requestfailed,maxdepthreached,maxrequestreachedanddisconnectedevents. - Improve debug logs by tracing public APIs and events.
Changed
- Allow
onSuccessandevaluatePageoptions asnull. - Change
crawler.isPaused,crawler.queueSize,crawler.pendingQueueSizeandcrawler.requestedCountfrom read-only properties to methods.
Fixed
- Fix a bug of ignoring maxDepth option.