Add an option to not download in case file already exists about icrawler

[hellock]

Good suggestion. Another option is to set file_idx_offset to "auto" if you are using the default filenames like 00000.jpg, 00001.jpg. Then it will not overwrite existing files, but search the maximum index n in the output folder and continue using n+1.jpg.

[dreamflasher]

What I had in mind was more about saving time for the download. I do a hash of the URL as filename, so for example if I have to restart the process, or have similar searches that potentially yield the same image, or I want to add the latest files and dont exactly know where I left off, then I don't want to download existing files again to save time.

[hellock]

I see your point. It will be really helpful if an option is provided to check the existence of filenames. It would be grateful if you can help to implement this feature, or I will add it later.