johnbumgarner / newshound

This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around the world in over 50 languages.

Currently under development. BETA will be released soon.

########### ########### ########### ########### ###########

NewsHound

---

 

       

Description

NewsHound is a Python 3 module that was designed to perform high quality news and article extraction for sources in multiple languages.

For instance NewsHound cleanly parses article content from the BBC in English, the Dainik Bhaskar in Hindi, the People's Daily in Chinese, the Malayala Manorama in Malayalam and the Khaosod in Thai.

The builtin extraction architecture is designed to systematically parse specific data elements from the underlying navigation structure of either an online web page or an offline file containing HTML content.

These data elements are:

• Title/Headline
• Description/Summary
• Keywords
• Name(s) of Author(s)
• Main Text/Content
• ISO Language
• Language Name
• Published Date
• Modified Date
• Canonical HREF
• Top Image HREF

Installation

NewsHound requires Python >=3.6. This package can be installed using pip3.

pip3 install newshound

Usage and Documentation

For detailed information on NewsHound please refer to the documentation.

• Package Dependencies

Predefined Extraction

The maintainers of NewsHound have developed and tested multiple predefined extraction modules for various news sources around the world. These specific extractors were developed to ensure consistent and accurate parsing from the news sources being queried. Additional sources will be added periodically to this predefined extraction list.

Development

If you would like to contribute to the NewsHound project please read the contributing guidelines.

Items currently under development:

• TDB after BETA release

Issues

This repository is actively maintained. Feel free to open any issues related to bugs, coding errors, broken links or enhancements.

You can also contact me at John Bumgarner with any issues or enhancement requests.

Sponsorship

If you would like to contribute financially to the development and maintenance of the NewsHound project please read the sponsorship information.

newshound's Issues

how to use

Newspaper3k has been unable to read the news content, would like to try newshound