needmorecowbell / sniff-paste Goto Github PK

Add option to bypass filtering, instead acting as a pipeline for funnel. ie: scrape all pastes and format them by content body and url. Pipe this stream of pastes to funnel, which will check each against it's yara library for valuable content.

It'd be great if the regex patterns were moved to a config file, and users could also specify direct keywords they want to find, so you don't need to edit the source code to make changes, remove patterns, etc.

You already covered this in another issue I think but the addition of YARA signature scanning of pastes would be fantastic as well. Specify rules path in config, along with the stuff above.

Pastebin Pro offers an API that is meant for scraping specifically. It's only available to paid users, though having the option of the standard scraping versus scraping API would be nice.

Pastebin Pro memberships are also only $50/lifetime so it's not an unattainable cost for most users I'd imagine

Either totally switch from mysql or make it the default option and keep mysql as an option. Just makes things simpler.