2022-11-20 02:37:56 [scrapy.core.scraper] ERROR: Spider error processing (referer: None)
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/scrapy/utils/defer.py", line 240, in iter_errback
yield next(it)
File "/usr/local/lib/python3.9/site-packages/scrapy/utils/python.py", line 338, in __next__
return next(self.data)
File "/usr/local/lib/python3.9/site-packages/scrapy/utils/python.py", line 338, in __next__
return next(self.data)
File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync
for r in iterable:
File "/usr/local/lib/python3.9/site-packages/scrapy/spidermiddlewares/offsite.py", line 29, in
return (r for r in result or () if self._filter(r, spider))
File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync
for r in iterable:
File "/usr/local/lib/python3.9/site-packages/scrapy/spidermiddlewares/referer.py", line 336, in
return (self._set_referer(r, response) for r in result or ())
File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync
for r in iterable:
File "/usr/local/lib/python3.9/site-packages/scrapy/spidermiddlewares/urllength.py", line 28, in
return (r for r in result or () if self._filter(r, spider))
File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync
for r in iterable:
File "/usr/local/lib/python3.9/site-packages/scrapy/spidermiddlewares/depth.py", line 32, in
return (r for r in result or () if self._filter(r, response, spider))
File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync
for r in iterable:
File "/opt/app/locations/spiders/luxottica.py", line 64, in parse
re.search(
AttributeError: 'NoneType' object has no attribute 'groups'
2022-11-20 02:37:57 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): []
2022-11-20 02:37:57 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading : []
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/scrapy/core/downloader/middleware.py", line 49, in process_request
return (yield download_func(request=request, spider=spider))
twisted.web._newclient.ResponseNeverReceived: []
2022-11-20 02:38:02 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): []
2022-11-20 02:38:02 [scrapy.core.scraper] ERROR: Error downloading
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/scrapy/core/downloader/middleware.py", line 49, in process_request
return (yield download_func(request=request, spider=spider))
twisted.web._newclient.ResponseNeverReceived: []