adam-gilman / crawlers Goto Github PK
View Code? Open in Web Editor NEWThis project forked from norconex/crawlers
Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or filesystem to various data repositories such as search engines.
Home Page: https://opensource.norconex.com/crawlers
License: Apache License 2.0