daddiofaddio / sitemap-extract Goto Github PK
View Code? Open in Web Editor NEWProcesses XML sitemaps and extracts URLs. Includes features such as support for both plain XML and compressed XML files, multiple input sources, protection against anti-bot measures, multi-threading, and automatic processing of nested sitemaps.
License: GNU Affero General Public License v3.0