2022-03-31 20:32:47 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.aosfatos.org/todas-as-declara%C3%A7%C3%B5es-de-bolsonaro/?q=cloroquina&o=> (referer: https://www.aosfatos.org/noticias/medicamentos-aprovados-covid-19/)
Traceback (most recent call last):
File "/Users/username/.pyenv/versions/3.9.10/envs/crau/lib/python3.9/site-packages/scrapy/utils/defer.py", line 132, in iter_errback
yield next(it)
File "/Users/username/.pyenv/versions/3.9.10/envs/crau/lib/python3.9/site-packages/scrapy/utils/python.py", line 354, in __next__
return next(self.data)
File "/Users/username/.pyenv/versions/3.9.10/envs/crau/lib/python3.9/site-packages/scrapy/utils/python.py", line 354, in __next__
return next(self.data)
File "/Users/username/.pyenv/versions/3.9.10/envs/crau/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 66, in _evaluate_iterable
for r in iterable:
File "/Users/username/.pyenv/versions/3.9.10/envs/crau/lib/python3.9/site-packages/scrapy/spidermiddlewares/offsite.py", line 29, in process_spider_output
for x in result:
File "/Users/username/.pyenv/versions/3.9.10/envs/crau/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 66, in _evaluate_iterable
for r in iterable:
File "/Users/username/.pyenv/versions/3.9.10/envs/crau/lib/python3.9/site-packages/scrapy/spidermiddlewares/referer.py", line 342, in <genexpr>
return (_set_referer(r) for r in result or ())
File "/Users/username/.pyenv/versions/3.9.10/envs/crau/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 66, in _evaluate_iterable
for r in iterable:
File "/Users/username/.pyenv/versions/3.9.10/envs/crau/lib/python3.9/site-packages/scrapy/spidermiddlewares/urllength.py", line 40, in <genexpr>
return (r for r in result or () if _filter(r))
File "/Users/username/.pyenv/versions/3.9.10/envs/crau/lib/python3.9/site-packages/scrapy/core/spidermw.py", line 66, in _evaluate_iterable
for r in iterable:
File "/Users/username/Documents/projects/pythonic-cafe/crau/crau/spider.py", line 164, in parse
self.write_warc(response)
File "/Users/username/Documents/projects/pythonic-cafe/crau/crau/spider.py", line 132, in write_warc
write_warc_request_response(self.warc_writer, response)
File "/Users/username/Documents/projects/pythonic-cafe/crau/crau/utils.py", line 172, in write_warc_request_response
get_headers_list(response.headers),
File "/Users/username/Documents/projects/pythonic-cafe/crau/crau/utils.py", line 147, in get_headers_list
return [
File "/Users/username/Documents/projects/pythonic-cafe/crau/crau/utils.py", line 148, in <listcomp>
(key.decode("ascii"), value[0].decode("ascii"))
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe7 in position 42: ordinal not in range(128)
