A simple Go tool to download and save the main content of a given webpage as an HTML file.
- Downloads the main content of a given webpage as an HTML file.
- Option to display metadata of the fetched webpage, including the number of links, images, and the last fetched timestamp.
Ensure you have Go installed on your machine.
make build./fetch <options> <URLs>./fetch https://www.example.com
./fetch --metadata https://www.example.com
./fetch https://www.example.com https://www.example.com/about
./fetch --metadata https://www.example.com https://www.example.com/aboutEnsure you have Docker installed on your machine.
make docker-buildmake docker-run ARGS="<options> <URLs>"make docker-run ARGS="https://www.example.com"
make docker-run ARGS="--metadata https://www.example.com"
make docker-run ARGS="https://www.example.com https://www.example.com/about"
make docker-run ARGS="--metadata https://www.example.com https://www.example.com/about"