Skip to content

v3.5.0

Choose a tag to compare

@andykais andykais released this 07 Feb 01:52
· 109 commits to master since this release
0fcdf02

Breaking change

  • no longer call
const { start, query } = scrape(config, options, params)

the library is now used like so

const scraper = new ScraperProgram(config, options, params)
scraper.start()
  • query arguments changed from query(args: { scraper: string[], groupBy: string }) to query(scrapers: string[], { groupBy: string })

Enhancements/fixes

  • add a scraper lock file to prevent two scrapers from clashing over the same directory
  • tests have better coverage of emitter values
  • add class methods for emitter emit events (stop, stopScraper, useRateLimiter)
  • error if commands are used unexpectedly (e.g. calling stop() before start())