captainjamason / boorudownloader

Lightweight Cross-Platform batch image downloader from Danbooru

booruDownloader

A lightweight cross-platform C++ program for downloading images in bulk from imageboard sites.

Features:

• Meson integrated build system.
• Danbooru support.
• Gelbooru support.
• More site support (Hopefully module flexibility?)
• Basic GUI done in wxwidgets
• Real time progress outputs in a non-invasive way.
• Multithreading
• Sorting by tag or rating into folders
• Customizable config

---

Requirements

• libcurl >= 8.5.0
• jsoncpp >= 1.9.5
• clang >= 17 (My primary compiler choice, May work with GCC...)
• meson >= 1.3.1

Build Instructions:

Auto Route:

./install.sh is a script written to check for dependencies and build as necessary. along with installing the binary to /usr/local/bin. Other options available with ./install.sh:

• --only-build: Will only output to ./build/src/boorudownloader, Won't install binary anywhere.
• --clean: Will clean the repository folder of any build remnants.
• --rebuild: Same idea as --clean but will also rebuild in the process.
• --uninstall: Will remove the binary from /usr/local/bin and delete /etc/boorudownloader/
• IN DEV: --portable: Will put the binary and config in ./bin, Handy for moving things around to different systems.

Manual Route:

• meson setup build && cd build
• meson compile Output will be in build/src/boorudownloader by default. This is useful for debugging any issues related to ./install.sh.

---

Configuration:

Configuration is handled inside one of three json formatted configuration files.

• ~./config/booruDownloader/config.json (preferred)
• /etc/booruDownloader/conf (example configuration)

It will also look for conf.json in the same folder as the binary. Useful for portable installs.

Please copy the example configuration to one of these folders; like so: mkdir ~./config/booruDownloader && cp /etc/booruDownloader/conf.json ~/.config/booruDownloader/conf.json

Options:

• user: Allows for input of username and API key for danbooru, Not currently used, May be handy to be integrated in future...
• testbooru: Enables or disables the use of testbooru in favor of danbooru. Mainly useful for debugging and development.

---

<3

Copyright 2024 - JPD/hurbIndustries

boorudownloader's Issues

Multithreading

This is a big one....

Nothing has been outright written with multithreading in mind. but it would be miles preferred.

If anyone has information to chime in on how to best approach this and pull it off that would be awesome.

Cleanup CLI Code

Yes, It's messy, No... I'm not proud of it...

I think if the arguments maybe got popped into a vector we'd be able to organize them a bit easier? It's something that will need to be done, no doubt about it.

Limit argument no longer working?

Well this is awkward...

Not exactly sure the cause. But may be a great first bug fix for someone itching to do a PR...

Organize/Tidy functions between files, along with classes and namespace.

I feel like there's more room to be had in terms of not keeping so much consolidated in a few files. No harm in spreading things out between files and making the codebase a bit tidier.

Improve color programming code for the CLI

As it currently stands, it is not very pretty code. Maybe a function to pass an std::string through and change the color of just that text?

Cmake build system.

This i'd like to get fledged out before we do any indev binary releases... I don't mind our current build system. But cmake would be a nice addition and help with cross platform interoperability.

Failure after 1000+ downloaded images.

After 1000+ downloaded images and 50-51 pages iterated through, libcurl has an SSL error. Unsure what may be causing it.

Compiles with ease.