From 5db770b0330aefe84ba186c7f714b17a2a797202 Mon Sep 17 00:00:00 2001 From: ProxyCrawl <39630115+proxycrawl@users.noreply.github.com> Date: Tue, 12 Nov 2019 09:26:04 +0800 Subject: [PATCH] Adds proxycrawl scrapy middleware --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index dc07735..e4779b7 100644 --- a/README.md +++ b/README.md @@ -68,6 +68,8 @@ * [scrapy-crawlera](https://github.com/scrapy-plugins/scrapy-crawlera) Crawlera routes requests through a pool of IPs, throttling access by introducing delays and discarding IPs from the pool when they get banned from certain domains, or have other problems. +* [scrapy-proxycrawl-middleware](https://github.com/proxycrawl/scrapy-proxycrawl-middleware) ProxyCrawl middleware allows to bypass captchas and blocks without using proxies. + ### Data Processing * [scrapy-elasticsearch](https://github.com/knockrentals/scrapy-elasticsearch) A scrapy pipeline which send items to Elastic Search server