GithubHelp home page GithubHelp logo

b08240 / scrawler Goto Github PK

View Code? Open in Web Editor NEW

This project forked from aandyprogram/scrawler

0.0 0.0 0.0 13.92 MB

๐Ÿณ๏ธโ€๐ŸŒˆ Media downloader from any sites, including Twitter, Reddit, Instagram, Threads, Facebook, OnlyFans, YouTube, Pinterest, PornHub, XHamster, XVIDEOS, ThisVid etc.

Home Page: https://discord.gg/uFNUXvFFmg

License: GNU General Public License v3.0

PowerShell 0.03% Batchfile 0.04% Visual Basic .NET 99.93%

scrawler's Introduction

๐Ÿณ๏ธโ€๐ŸŒˆ Happy LGBT Pride Month ๐ŸŽ‰

๐Ÿณ๏ธโ€๐ŸŒˆ Social networks crawler ๐Ÿณ๏ธโ€๐ŸŒˆ

GitHub release (latest by date) GitHub license Discord GitHub all releases FAQ GUIDE How to support ๐Ÿ‡ช๐Ÿ‡บ ๐Ÿ‡ฌ๐Ÿ‡ท

A program to download photo and video from any site (e.g. YouTube, YouTube Music, OnlyFans, Reddit, Twitter, Mastodon, Instagram, Threads, Facebook, TikTok, RedGifs, JustForFans, PornHub, XHamster, XVIDEOS, ThisVid, LPSG, Pinterest).

If you like SCrawler, please like the program on this site and/or this

Join our Discord server: https://discord.gg/uFNUXvFFmg
If you have problems using the program, you can get help faster on our Discord server!

Bitcoin: BC1Q0NH839FT5TA44DD7L7RLR97XDQAG9V8D6N7XET

Main window Channels window

YouTube standalone application:

YouTube application

What can program do:

  • Download pictures and videos from users' profiles and subreddits:
    • YouTube videos, shorts, community feeds, users, artists, playlists, music, tracks;
    • Reddit images, galleries of images, videos, saved posts;
    • Redgifs videos (https://www.redgifs.com/);
    • Twitter images and videos, saved (bookmarked) posts, likes, communities;
    • OnlyFans images and videos, saved (bookmarked) posts, stories;
    • JustForFans images and videos, saved (bookmarked) posts;
    • Mastodon images and videos, saved (bookmarked) posts;
    • Instagram images and videos, tagged posts, stories, saved posts;
    • Threads images and videos;
    • Facebook images and videos, stories, saved posts;
    • TikTok videos;
    • Pinterest boards, users, saved posts;
    • Imgur images, galleries and videos;
    • Gfycat videos;
    • PornHub images, videos, save (liked) posts, search queries, search categories;
    • XHamster images, videos, saved posts, search queries, search categories, search tags;
    • XVIDEOS videos, saved posts, search queries, search categories;
    • ThisVid images, videos, saved posts, search queries, search categories, search tags;
    • Other supported sites
  • Parse Reddit channel and view data
  • Download saved posts
  • Add users from parsed channel
  • Advanced user management
  • Automation (downloading data automatically every X minutes)
  • Feed (feed of downloaded media files and subscriptions posts)
  • Multiple accounts support
  • Labeling users
  • Create download groups
  • Adding users to favorites and temporary
  • Adding users and search queries in the Subscription mode (download post preview, but do not download the media file)
  • Filter exists users by label or group
  • Selection of media types you want to download (images only, videos only, both)
  • Download a special video, image or gallery
  • Making collections (grouping users into collections)
  • Specifying a user folder (for downloading data to another location)
  • Changing user icons
  • Changing view modes
  • ...and many others...

Supported sites

  • YouTube
  • YouTube Music
  • Reddit
  • Twitter
  • OnlyFans (partial support)1
  • Instagram
  • Threads
  • Facebook
  • JustForFans (partial support)1
  • Mastodon (out of support)
  • TikTok
  • RedGifs
  • Pinterest
  • Imgur
  • Gfycat
  • LPSG
  • PornHub
  • XHamster
  • XVIDEOS
  • ThisVid
  • Other sites

SITES REQUIREMENTS

How it works

First, the program downloads the full profile. After the program downloads only new posts. The program remembers downloaded posts.

How to request a new site

I'm currently not accepting requests to develop new sites.

Requirements

  • Windows 10, 11 with NET Framework 4.6.1 or higher (v4.6.1 must be installed). You can check version compatibility with this tool.
  • SITES REQUIREMENTS

Guide

Full guide you can find here

Video on how to configure

How to configure

Installation

Just download the latest release, unzip the program archive to any folder and enjoy. ๐Ÿ˜Š

Don't put program in the Program Files system folder (this is portable program and program settings are stored in the program folder)

I highly doubt you can run SCrawler on Linux or Mac. SCrawler is a program that is heavily dependent on Windows.

Updating

Just download latest version and unpack it into the program folder. Before launching a new version, I recommend making a backup copy of the program settings folder and user settings/data files.

You can also use the updater included in the release package.

Settings and usage

The program has an intuitive interface.

SITES REQUIREMENTS

How to configure

Just add a user profile and click the Download button.

stateDiagram
Start: Add site credentials
What: What would I like to do
DownUser: Download user
DownVideo: Download video
AUser: Add user (1)
OVIF: Open standalone downloader (2)
AVideo: Add video url
F5: Press 'F5' or click the download button
[*]-->Start
Start-->What
What-->DownUser
What-->DownVideo
DownUser-->AUser
DownVideo-->OVIF
OVIF-->AVideo
AVideo-->F5
AUser-->F5
F5-->[*]
Loading
  1. Press Insert or click the Download button (read more here, hot keys)
  2. Click the Download button, then Standalone downloader (read more here)

Add user

Contact me

Discord server: https://discord.gg/uFNUXvFFmg

Footnotes

  1. Partial support means that I don't have personal accounts on paid porn sites because I don't pay for porn. If this site has stopped downloading and you want me to fix it, please be ready to give me access to an account with at least one active subscription. Otherwise, the download from this site will not be fixed. โ†ฉ โ†ฉ2

scrawler's People

Contributors

aandyprogram avatar unknown81311 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.