Checks any URL input format. Check includes:
- having a robots.txt file on the site;
- robots.txt server response code;
- weight robots.txt;
- presence of the Host directive in the robots.txt file etc.;
Displays the table with the result and you can download it.
- php;
- PhpSpreadsheet;