Website mirroring about archives

[hsanjuan]

I think someone might have written such tool, crawling a website + adding to ipfs, but I am not sure anymore. Would be great if someone can comment. It might just also be a concatenation of wget+ipfs add.

[sysfu]

There are already several more or less mature tools that allow users to download entire websites and store them locally on a hard drive. Perhaps the initial focus should be on figuring how to insert these local web site mirrors into the ipfs network.

Once that part of the problem is solved and stable, additional development resources can go towards developing the component that downloads existing website structures, and immediately uploads them into ipfs without the need of a local cache or copy.