v6.0.0

💥 Breaking changes

• internal plugins are no longer exported from the module (import * as plugins from 'website-scraper/plugins')
• Drop support of NodeJS 14, 16 and 18. Minimum supported NodeJS version 20.18.1

What's Changed

• #510 Remove plugin exports and update docs by @ryanolee in #511
• Fix ENOENT when running from working directory without package.json by @s0ph1e in #516
• Bump normalize-url from 7.2.0 to 8.0.0 by @dependabot[bot] in #517
• Bump paambaati/codeclimate-action from 3.0.0 to 3.2.0 by @dependabot[bot] in #520
• Bump actions/setup-node from 2 to 3 by @dependabot[bot] in #519
• Bump sinon from 14.0.2 to 15.0.0 by @dependabot[bot] in #524
• Bump fs-extra from 10.1.0 to 11.1.0 by @dependabot[bot] in #523
• Bump paambaati/codeclimate-action from 3.2.0 to 4.0.0 by @dependabot[bot] in #527
• Extend list of nodejs versions to test by @aivus in #528
• Bump c8 from 7.14.0 to 8.0.0 by @dependabot[bot] in #531
• Bump paambaati/codeclimate-action from 4.0.0 to 5.0.0 by @dependabot[bot] in #532
• Bump actions/checkout from 2 to 3 by @dependabot[bot] in #521
• Drop support of old NodeJS versions (14, 16) by @aivus in #536
• Bump actions/checkout from 3 to 4 by @dependabot[bot] in #534
• Bump got from 12.6.1 to 13.0.0 by @dependabot[bot] in #529
• Bump sinon from 15.2.0 to 16.1.0 by @dependabot[bot] in #539
• Bump sinon from 16.1.3 to 17.0.0 by @dependabot[bot] in #540
• Bump actions/setup-node from 3 to 4 by @dependabot[bot] in #541
• Bump actions/stale from 8 to 9 by @dependabot[bot] in #543
• Bump p-queue from 7.4.1 to 8.0.0 by @dependabot[bot] in #544
• Bump github/codeql-action from 2 to 3 by @dependabot[bot] in #545
• Bump c8 from 8.0.1 to 9.1.0 by @dependabot[bot] in #547
• Update issue templates by @s0ph1e in #552
• Bump paambaati/codeclimate-action from 5.0.0 to 6.0.0 by @dependabot[bot] in #555
• Bump sinon from 17.0.2 to 18.0.0 by @dependabot[bot] in #558
• Bump c8 from 9.1.0 to 10.0.0 by @dependabot[bot] in #562
• Bump paambaati/codeclimate-action from 6.0.0 to 8.0.0 by @dependabot[bot] in #565
• Use v2 tag for coveralls GH action by @aivus in #575
• Bump cheerio from 1.0.0-rc.12 to 1.0.0 by @dependabot[bot] in #574
• Bump paambaati/codeclimate-action from 8.0.0 to 9.0.0 by @dependabot[bot] in #577
• Bump sinon from 18.0.1 to 19.0.2 by @dependabot[bot] in #578
• Update node.js versions in Github Action by @aivus in #583
• Bump mocha from 10.8.2 to 11.0.1 by @dependabot[bot] in #582
• Bump nock from 13.5.6 to 14.0.0 by @dependabot[bot] in #585
• Bump sinon from 19.0.5 to 20.0.0 by @dependabot[bot] in #587
• Bump cheerio from 1.0.0 to 1.1.0 by @dependabot[bot] in #589
• Use Qlty instead of Code Climate by @aivus in #593
• Bump cheerio from 1.1.0 to 1.1.2 by @dependabot[bot] in #594
• Bump got from 13.0.0 to 14.4.7 by @dependabot[bot] in #588
• Bump sinon from 20.0.0 to 21.0.0 by @dependabot[bot] in #590
• Drop support of NodeJS 18 by @aivus in #595
• Bump qltysh/qlty-action from 1 to 2 by @dependabot[bot] in #596
• Bump actions/checkout from 4 to 5 by @dependabot[bot] in #597
• Bump actions/stale from 9 to 10 by @dependabot[bot] in #598
• Bump actions/setup-node from 4 to 5 by @dependabot[bot] in #599
• Bump p-queue from 8.1.1 to 9.0.0 by @dependabot[bot] in #600
• Bump github/codeql-action from 3 to 4 by @dependabot[bot] in #601
• Bump actions/setup-node from 5 to 6 by @dependabot[bot] in #602
• "got" npm package changed the response in 14.6.0/14.6.1 by @aivus in #603
• Add sponsors workflow by @aivus in #604

Full Changelog: v5.3.1...v6.0.0

v5.3.1

What's Changed

• Fix ENOENT when running from working directory without package.json

Full Changelog: v5.3.0...v5.3.1

v5.3.0

What's Changed

• Bump cheerio from 1.0.0-rc.11 to 1.0.0-rc.12 by @dependabot in #499
• Use encoding from resource text by @s0ph1e in #504

Full Changelog: v5.2.0...v5.3.0

v5.2.0

What's Changed

• fix: non-english char encoding by @phawxby in #496

New Contributors

• @phawxby made their first contribution in #496

Full Changelog: v5.1.0...v5.2.0

v5.1.0 [deprecated]

What's Changed

• Fix encoding issue for non-English websites #482
• Bump cheerio from 1.0.0-rc.10 to 1.0.0-rc.11 by @dependabot in #491

⚠️ Version 5.1.0 was deprecated because of bugs introduced by encoding changes #493, failed tests in website-scraper-puppeteer

Full Changelog: v5.0.0...v5.1.0

v5.0.0

💥 Breaking changes

• module requires nodejs version >= 14.14
• module is now pure ESM and cannot be required from CommonJS module. Read more about ESM modules
• options.request may need to be changed, underlying http library was updates from request(deprecated) to got
• scrape.defaults now can be imported with import defaultOptions from 'website-scraper/defaultOptions';
• scrape.plugins now can be imported with import * as plugins from 'website-scraper/plugins';
• callback usage support was removed, now only promises and async/await are supported

🐛 Bug fixes

• urlFilter is no longer applied for root resources #460
• issue with wrong quotes in generated html is fixed #355

🌵 Other changes

• cheerio (underlying dependency for html parsing) was updated from version 0.22 to 1.0.0-rc.10

v4.2.3

• 529e27c - fix file save error on windows #413
• update dependencies

v4.2.2

• db206b7 Scrape resources with query strings when using bySiteStructure

v4.2.1

• c565e14 fix attributes with html-entity encoded quotes

v4.2.0

• 7cc60db add responseData to generateFilename action params