yutkin / lenta.ru-news-dataset Goto Github PK

 | tags | text | title | topic | url
0 | Общество | Миллиардер Илон Маск в резкой форме ответил бр... | Илон Маск назвал педофилом спасавшего детей из... | Мир | https://lenta.ru/news/2018/07/16/su57/

concurrent.futures.process._RemoteTraceback: 

"""

Traceback (most recent call last):

  File "/usr/lib/python3.6/concurrent/futures/process.py", line 175, in _process_worker

    r = call_item.fn(*call_item.args, **call_item.kwargs)

  File "download_lenta.py", line 71, in parse_article_html

    topic = doc_tree.find("a", "b-header-inner__block").get_text()

AttributeError: 'NoneType' object has no attribute 'get_text'

"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

  File "download_lenta.py", line 98, in fetch_all_news_on_page

    processed_artile = future.result()

  File "/usr/lib/python3.6/concurrent/futures/_base.py", line 425, in result

    return self.__get_result()

  File "/usr/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result

    raise self._exception

AttributeError: 'NoneType' object has no attribute 'get_text'

16-07-2018 10:19:33 - LentaParser - ERROR @ Error while processing https://lenta.ru/news/2014/06/19/s5prime/

concurrent.futures.process._RemoteTraceback: 

"""

Traceback (most recent call last):

  File "/usr/lib/python3.6/concurrent/futures/process.py", line 175, in _process_worker

    r = call_item.fn(*call_item.args, **call_item.kwargs)

  File "download_lenta.py", line 67, in parse_article_html

    paragraphs = doc_tree.find("div", attrs={"itemprop": "articleBody"}).find_all(

AttributeError: 'NoneType' object has no attribute 'find_all'

"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

  File "download_lenta.py", line 98, in fetch_all_news_on_page

    processed_artile = future.result()

  File "/usr/lib/python3.6/concurrent/futures/_base.py", line 425, in result

    return self.__get_result()

  File "/usr/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result

    raise self._exception

AttributeError: 'NoneType' object has no attribute 'find_all'