s3mon / s3mon

monitor s3 buckets for missing files

s3mon

monitor s3 buckets for missing files

https://s3mon.dev

s3mon's Issues

error: failed to run custom build command for `openssl v0.9.24`

Can't build in circleci or Docker images because of this error:

 error: failed to run custom build command for `openssl v0.9.24`

output of cargo tree -i -p openssl:0.9.24: (cargo install cargo-tree)

circleci@e18b4d60bed1:~/project$ cargo tree -i -p openssl:0.9.24
 Downloading crates ...
  Downloaded winapi v0.3.8
openssl v0.9.24
└── native-tls v0.1.5
    ├── hyper-tls v0.1.4
    │   └── reqwest v0.7.3
    │       └── slack-hook v0.7.0
    │           └── s3mon v0.1.2 (/home/circleci/project)
    ├── reqwest v0.7.3 (*)
    └── tokio-tls v0.1.4
        ├── hyper-tls v0.1.4 (*)
        └── reqwest v0.7.3 (*)

create tests

implement code tets

clean and optimize code (remove unwraps)

Organize and clean the code in a way that could be extended easily, besides following best practices to better handle errors and remove usage of unwraps

option to define different outputs and formats

If a 3rd party tool for example telegraf calls periodically s3mon have an option to configure the output so that it could be used to simplify collecting metrics.

Either could return the files found or a true/false if no files found for the defined period.

go asynchronous

rusoto is async-ready, so instead of spawning a thread per bucket (and immediately calling .sync()) your application could be made to "properly" use asynchronous programming

resolves #4, #1

improve documentation

better docs, fix typos etc, source of docs are in https://github.com/s3mon/public and the bottom page includes Suggest edit ✍ for example:

https://github.com/s3mon/public/edit/master/post/how-it-works.md

use only region without defining an endpoint (AWS only)

https://stackoverflow.com/q/58341359/1135424

rusoto/rusoto#1531

prevent cloning to much

Need code review / refactor to prevent cloning to much, probably using lifetimes would be better

https://github.com/s3mon/s3mon/blob/master/src/main.rs#L46-L53