ammarfaizi2 / fb_scraper

Installation

1. Download and Composer Install

git clone https://github.com/ammarfaizi2/fb_scraper
cd fb_scraper
composer install -vvv

2. Prepare your database mysql and import db.sql
3. Edit config.php

Group posts scraper

** Make sure you have joined the group before performing the group posts scraper! **

php group.php [group_id]

Profile and Fanspage posts scraper

php timeline_scraper.php [user_id or username]

fb_scraper's Issues

[REQUEST] column files_name

mirip seperti file, namun berbentuk namafile dan format, contoh

30740387_110102763183511_3033312637941950578_n.jpg

yang mana hasil dari :

a = "https://scontent-sin6-1.xx.fbcdn.net/v/t1.0-9/fr/cp0/e15/q65/30740387_110102763183511_3033312637941950578_n.jpg?_nc_cat=0&efg=eyJpIjoiYiJ9&oh=68941f4400a3e069ed5cddc41bd4e256&oe=5B695385"
a = a.split("?")[0].split("/").last
a # => 30740387_110102763183511_3033312637941950578_n.jpg

thank you !

[REQUEST] 1 row menyimpan 1 post dengan multiple gambar

Contoh post :

Row di database :

excepted result :
column text berisi status, dan files berisi array ["imageurl1", "imageurl2", "imageurl3"]

url : https://scontent-sin6-1.xx.fbcdn.net/v/t1.0-9/fr/cp0/e15/q65/30740387_110102763183511_3033312637941950578_n.jpg?_nc_cat=0&efg=eyJpIjoiYiJ9&oh=68941f4400a3e069ed5cddc41bd4e256&oe=5B695385

simpan group id pada database

mar, kan pas mulai ada group id, ex 1452906758121055 as argument, nah itu sekalian dong simpan ke db, jadi biar tau post A disimpen dari group mana, thank you !

[REQUEST] get original status/post date

get original status/post date,