isabella232 / algolia-docsearch-scraper

This repository holds the code of the Algolia DocSearch scraper used to power the Livepeer.com docs.

DocSearch scraper

This repository holds the code of the DocSearch scraper used to power the hosted version of DocSearch.

If you're looking for a way to add DocSearch to your site, the easiest solution is to apply to DocSearch. To run the scraper yourself, you're at the right place.

Installation and Usage

Please check the dedicated documentation to see how you can install and run DocSearch yourself.

This project supports Python 3.6+

Run It

docker run -it --env-file=.env -e "CONFIG=$(cat ./docsearch-config.json | jq -r tostring)" algolia/docsearch-scraper

Related projects

DocSearch is made of 4 repositories:

• algolia/DocSearch contains the docsearch.js code source.
• algolia/docsearch-configs contains the JSON files representing all the configurations for all the documentations DocSearch is powering.
• algolia/docsearch-scraper contains the scraper we use to extract data from your documentation. The code is open source and you can run it from a Docker image.
• algolia/docsearch-website contains the documentation website.