2022-11-19 16:38:39 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://stores.worldmarket.com/ny/brooklyn.html) Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/scrapy/utils/defer.py", line 240, in iter_errback yield next(it) File "/usr/local/lib/python3.9/site-packages/scrapy/utils/python.py", line 338, in __next__ return next(self.data) File "/usr/local/lib/python3.9/site-packages/scrapy/utils/python.py", line 338, in __next__ return next(self.data) File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync for r in iterable: File "/usr/local/lib/python3.9/site-packages/scrapy/spidermiddlewares/offsite.py", line 29, in return (r for r in result or () if self._filter(r, spider)) File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync for r in iterable: File "/usr/local/lib/python3.9/site-packages/scrapy/spidermiddlewares/referer.py", line 336, in return (self._set_referer(r, response) for r in result or ()) File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync for r in iterable: File "/usr/local/lib/python3.9/site-packages/scrapy/spidermiddlewares/urllength.py", line 28, in return (r for r in result or () if self._filter(r, spider)) File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync for r in iterable: File "/usr/local/lib/python3.9/site-packages/scrapy/spidermiddlewares/depth.py", line 32, in return (r for r in result or () if self._filter(r, response, spider)) File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync for r in iterable: File "/opt/app/locations/spiders/costplus_worldmarket.py", line 65, in parse_store ref = re.findall(r".com/(.+?)/(.+?)/(.+).html", response.url)[0] IndexError: list index out of range