v3.5.0
Breaking change
- no longer call
const { start, query } = scrape(config, options, params)the library is now used like so
const scraper = new ScraperProgram(config, options, params)
scraper.start()- query arguments changed from
query(args: { scraper: string[], groupBy: string })toquery(scrapers: string[], { groupBy: string })
Enhancements/fixes
- add a scraper lock file to prevent two scrapers from clashing over the same directory
- tests have better coverage of emitter values
- add class methods for emitter emit events (
stop, stopScraper, useRateLimiter) - error if commands are used unexpectedly (e.g. calling stop() before start())