pipetto-crypto / pegasus-scraper

Pegasus-scraper

DISCLAIMER:

While you have the freedom to put your games wherever you want, in order for the script to be able to add launch commands properly you need to put games from different systems in different folders else you will have to add launch commands manually.

Simple bash script that mainly scrapes games for you, eventually it can configure Pegasus to load your games folders but access to storage is broken in Android 11+ so that's not is intended purpose. To use:

Download termux from fdroid and paste the following commands:

termux-setup-storage, answer yes when prompted.

curl -O -L https://github.com/Pipetto-crypto/pegasus-scraper/raw/master/installer.sh && source installer.sh

Type pegasus-config everytime you want to scrape new games.

About The Scripts

The installer script will install the required dependencies and compile skyscraper.

It will create a basic artwork file and config file for skyscraper to work.

During the execution, you will be prompted to edit the config file with nano, it's highly suggested to use something with arrows keys(either a physical keyboard, Hacker Keyboard from PlayStore or a gamepad).

The configurator script will allow you to do the following tasks:

1. Edit the config file with nano to add new systems.

2. Scrape your games by selecting platforms and scraping modules:

For a list of supported platforms refer to this: https://github.com/muldjord/skyscraper/blob/master/docs/PLATFORMS.md

For a list of supported scraping modules refer to this: https://github.com/muldjord/skyscraper/blob/master/docs/SCRAPINGMODULES.md

3. Add a launch command to the metadata file, required for Pegasus to open your games with an emulator.

If you have done what the disclaimer says then this operation will be able to add launch commands completely automatically. Else you can fall back to manual editing with nano.

For a list of launch commands, you may refer to this: https://pegasus-frontend.org/tools/metagen-android/

4. Configure Pegasus to be able to launch your games

pegasus-scraper's Issues

Project ERROR: Cannot run target compiler 'clang++'. Output:

Error
Note 20 Ultra
Android 12

Project ERROR: Cannot run target compiler 'clang++'. Output:

===================
Maybe you forgot to setup the environment?
make: *** No targets specified and no makefile found. Stop.

E: The repository 'https://dl.bintray.com/grimler/game-packages-24 games Release' does not have a Release file.
N: Metadata integrity can't be verified, repository is disabled now.
N: Possible cause: repository is under maintenance or down (wrong sources.list URL?).

$ curl -O -L https://github.com/Pipetto-crypto/pegasus-scraper/raw/master/installer.sh && source installer.sh
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:-100 150 100 150 0 0 227 0 --:--:-- --:--:-- --:--:-- 227
0 0 0 0 0 0 0 0 --:--:-- --:-100 2419 100 2419 0 0 2758 0 --:--:-- --:--:-- --:--:-- 12935
Before I start, do you want me to fetch Pegasus for you?(y/n):n

Updating, upgrading packages and install x11-repo

Checking availability of current mirror: ok
Ign:1 https://dl.bintray.com/grimler/game-packages-24 games InRelease
Ign:2 https://dl.bintray.com/grimler/science-packages-24 science InRelease
Hit:3 https://packages.termux.org/apt/termux-x11 x11 InRelease
Hit:4 https://termux.mentality.rip/termux-packages-24 stable InRelease
Err:5 https://dl.bintray.com/grimler/game-packages-24 games Release
502 Bad Gateway
Err:6 https://dl.bintray.com/grimler/science-packages-24 science Release
502 Bad Gateway
Reading package lists... Done
E: The repository 'https://dl.bintray.com/grimler/game-packages-24 games Release' does not have a Release file.
N: Metadata integrity can't be verified, repository is disabled now.
N: Possible cause: repository is under maintenance or down (wrong sources.list URL?).
E: The repository 'https://dl.bintray.com/grimler/science-packages-24 science Release' does not have a Release file.
N: Metadata integrity can't be verified, repository is disabled now.
N: Possible cause: repository is under maintenance or down (wrong sources.list URL?).
Checking availability of current mirror: ok
Reading package lists... Done
Building dependency tree
Reading state information... Done
x11-repo is already the newest version (8.0).
0 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.

Installing dependencies

Checking availability of current mirror: ok
Reading package lists... Done
Building dependency tree
Reading state information... Done
build-essential is already the newest version (4.1).
git is already the newest version (2.35.0).
wget is already the newest version (1.21.1-1).
qt5-qtbase is already the newest version (5.12.11-8).
0 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.

Cloning, compiling and installing Skyscraper

Cloning into 'skyscraper'...
remote: Enumerating objects: 11233, done.
remote: Counting objects: 100% (422/422), done.
remote: Compressing objects: 100% (294/294), done.
Receiving objects: 51% (5801/11233), 11.26 MiB | 4.73 MiB/Receiving objects: 51% (5803/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 52% (5842/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 53% (5954/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 54% (6066/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 55% (6179/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 56% (6291/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 57% (6403/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 58% (6516/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 59% (6628/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 60% (6740/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 61% (6853/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 62% (6965/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 63% (7077/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 64% (7190/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 65% (7302/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 66% (7414/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 67% (7527/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 68% (7639/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 69% (7751/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 70% (7864/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 71% (7976/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 72% (8088/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 73% (8201/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 74% (8313/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 75% (8425/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 76% (8538/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 77% (8650/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 78% (8762/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 79% (8875/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 80% (8987/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 81% (9099/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 82% (9212/11233), 13.43 MiB | 4.67 MiB/Receiving objects: 83% (9324/11233), 15.98 MiB | 4.73 MiB/Receiving objects: 84% (9436/11233), 15.98 MiB | 4.73 MiB/Receiving objects: 85% (9549/11233), 15.98 MiB | 4.73 MiB/Receiving objects: 86% (9661/11233), 15.98 MiB | 4.73 MiB/Receiving objects: 87% (9773/11233), 15.98 MiB | 4.73 MiB/Receiving objects: 88% (9886/11233), 15.98 MiB | 4.73 MiB/Receiving objects: 89% (9998/11233), 15.98 MiB | 4.73 MiB/Receiving objects: 90% (10110/11233), 15.98 MiB | 4.73 MiBReceiving objects: 91% (10223/11233), 15.98 MiB | 4.73 MiBReceiving objects: 92% (10335/11233), 15.98 MiB | 4.73 MiBReceiving objects: 93% (10447/11233), 15.98 MiB | 4.73 MiBReceiving objects: 94% (10560/11233), 15.98 MiB | 4.73 MiBReceiving objects: 95% (10672/11233), 15.98 MiB | 4.73 MiBReceiving objects: 96% (10784/11233), 15.98 MiB | 4.73 MiBReceiving objects: 97% (10897/11233), 15.98 MiB | 4.73 MiBReceiving objects: 98% (11009/11233), 15.98 MiB | 4.73 MiBReceiving objects: 99% (11121/11233), 15.98 MiB | 4.73 MiBremote: Total 11233 (delta 268), reused 243 (delta 115), pack-reused 10811
Receiving objects: 100% (11233/11233), 15.98 MiB | 4.73 MiBReceiving objects: 100% (11233/11233), 18.07 MiB | 4.71 MiB/s, done.
Resolving deltas: 100% (7906/7906), done.
Project ERROR: Cannot run target compiler 'clang++'. Output:

===================
Maybe you forgot to setup the environment?
make: *** No targets specified and no makefile found. Stop.
mv: cannot stat 'Skyscraper': No such file or directory

Installed, returning back to home folder
mkdir: cannot create directory ‘.skyscraper’: File exists

Creating artwork.xml

--2022-01-28 19:36:55-- https://raw.githubusercontent.com/muldjord/skyscraper/master/artwork.xml
Resolving raw.githubusercontent.com... 185.199.110.133, 185.199.108.133, 185.199.111.133, ...
Connecting to raw.githubusercontent.com|185.199.110.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 881 [text/plain]
Saving to: ‘artwork.xml’

artwork.xml 100% 881 --.-KB/s in 0s

2022-01-28 19:36:55 (13.7 MB/s) - ‘artwork.xml’ saved [881/881]