p4u / domaincrawler Goto Github PK
View Code? Open in Web Editor NEWIt is an HTTP crawler which looks for domains in <a> tags and sotres them into a sqlite database next to their IP address. it works recursively among the stored domains.
License: GNU General Public License v2.0