2022-11-20 13:19:03 [scrapy.core.scraper] ERROR: Spider error processing (referer: None)
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/scrapy/utils/defer.py", line 240, in iter_errback
yield next(it)
File "/usr/local/lib/python3.9/site-packages/scrapy/utils/python.py", line 338, in __next__
return next(self.data)
File "/usr/local/lib/python3.9/site-packages/scrapy/utils/python.py", line 338, in __next__
return next(self.data)
File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync
for r in iterable:
File "/usr/local/lib/python3.9/site-packages/scrapy/spidermiddlewares/offsite.py", line 29, in
return (r for r in result or () if self._filter(r, spider))
File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync
for r in iterable:
File "/usr/local/lib/python3.9/site-packages/scrapy/spidermiddlewares/referer.py", line 336, in
return (self._set_referer(r, response) for r in result or ())
File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync
for r in iterable:
File "/usr/local/lib/python3.9/site-packages/scrapy/spidermiddlewares/urllength.py", line 28, in
return (r for r in result or () if self._filter(r, spider))
File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync
for r in iterable:
File "/usr/local/lib/python3.9/site-packages/scrapy/spidermiddlewares/depth.py", line 32, in
return (r for r in result or () if self._filter(r, response, spider))
File "/usr/local/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 79, in process_sync
for r in iterable:
File "/opt/app/locations/spiders/xpo_logistics.py", line 18, in parse
data = ast.literal_eval(script)
File "/usr/local/lib/python3.9/ast.py", line 105, in literal_eval
return _convert(node_or_string)
File "/usr/local/lib/python3.9/ast.py", line 104, in _convert
return _convert_signed_num(node)
File "/usr/local/lib/python3.9/ast.py", line 78, in _convert_signed_num
return _convert_num(node)
File "/usr/local/lib/python3.9/ast.py", line 69, in _convert_num
_raise_malformed_node(node)
File "/usr/local/lib/python3.9/ast.py", line 66, in _raise_malformed_node
raise ValueError(f'malformed node or string: {node!r}')
ValueError: malformed node or string: None