The frieren-scraper from tomojl

Challenge

Scrape only using
- Axios
- Cheerio

and results must be JSON Object.

Target

You decide, you can open issues what website/app and data to be scrapped.

Website
- Doujindesu
- Otakudesu
- Youtube
- Anoboy
- Komiku.id
- Danbooru
- Apkmody.io
- PhotoFunia
- Hentai.tv
- bokepsin
App
- Status Video Wa Indonesia
- Unsplash
- Downloader for tiktok
  - App use rapid Api.
- SuperDownloader

Progress.

Usage

Install packages.

Using GitHub version to test latest fix/update.

npm install github:xct007/frieren-scraper

Notice.

Package name changed to @xct007/frieren-scraper

Example use

Social Media.

Youtube

import { youtube } from "@xct007/frieren-scraper";

// searching videos
const ArrObj = await youtube.search("rose gone mv");
console.log(ArrObj);

// fetch download url;
const Obj = await youtube.download("https://www.youtube.com/watch?v=xxx");
console.log(Obj);

Tiktok

import { tiktok } from "@xct007/frieren-scraper";

// v1. fetch detail/download url
const Obj = await tiktok.v1("https://TIKTOK_URL");
console.log(Obj);

// others version will added soon.

Instagram

import { instagram } from "@xct007/frieren-scraper";

// v1. fetch direct download url
const Obj = await instagram.v1("https://instagram_URL");
console.log(Obj);

// others version will added soon.

Facebook.

import { facebook } from "@xct007/frieren-scraper";

// v1. fetch direct download url
const Obj = await facebook.v1("https://FACEBOOK_URL");
console.log(Obj);

// others version will added soon.

Story WhatsApp Videos.

import { storyWa } from "@xct007/frieren-scraper";

// fetch popular videos
const ArrObj = await storyWa.popular();
console.log(ArrObj);

// search videos by query
const ArrObj = await storyWa.search("query");
console.log(ArrObj);

ZippyShare. (Not working)

import { zippyshare } from "@xct007/frieren-scraper";

// fetch direct download url
const Obj = await zippyshare.download("https://ZIPPYSHARE_URL");
console.log(Obj);

Pinterest.

import { pinterest } from "@xct007/frieren-scraper";

// v1. fetch direct download url
const Obj = await pinterest.v1("https://PINTEREST_URL");
console.log(Obj);

// others version will added soon.

Anime/comic.

Komiku.id.

import { komikuId } from "@xct007/frieren-scraper";

// fetch latest comic
const ArrObj = await komikuId.latest();
console.log(ArrObj);

// search comic by query
const ArrObj = await komikuId.search("query");
console.log(ArrObj);

// fetch comic/chapter detail by url.
const Obj = await komikuId.detail("https://KOMIKUID_URL");
console.log(Obj);

Otakudesu.

import { otakudesu } from "@xct007/frieren-scraper";

// fetch latest anime
const ArrObj = await otakudesu.latest();
console.log(ArrObj);

// search anime by query
const ArrObj = await otakudesu.search("query");
console.log(ArrObj);

// fetch anime detail by url
const Obj = await otakudesu.detail("https://OTAKUDESU_URL");
console.log(Obj);

Anoboy.

import { anoboy } from "@xct007/frieren-scraper";

// fetch latest anime
const ArrObj = await anoboy.latest();
console.log(ArrObj);

// search anime by query
const ArrObj = await anoboy.search("query");
console.log(ArrObj);

// fetch anime detail by url
const Obj = await anoboy.search("https://ANOBOY_URL");
console.log(Obj);

Doujindesu.

import { doujindesu } from "@xct007/frieren-scraper";

// fetch latest doujin
const ArrObj = await doujindesu.latest();
console.log(ArrObj);

// search doujin by query
const ArrObj = await doujindesu.search("query");
console.log(ArrObj);

// fetch doujin detail by url
const Obj = await doujindesu.detail("https://DOUJINDESU_URL");
console.log(Obj);

Searching?

Unsplash.

import { unsplash } from "@xct007/frieren-scraper";

// Search images by query
const ArrObj = await unsplash.search("query");
console.log(ArrObj);

Danbooru.

import { danbooru } from "@xct007/frieren-scraper";

// Search images by query
const ArrObj = await danbooru.search("query");
console.log(ArrObj);

Music.

import { music } from "@xct007/frieren-scraper";

// Search music and audio url by query.
// more short query, more results found.
const ArrObj = await music.search("query");
console.log(ArrObj);

Apkmody.

import { apkmody } from "@xct007/frieren-scraper";

// search apps/games
const ArrObj = await apkmody.search("query");
console.log(ArrObj);

// fetch direct download url
// High memory usage. LOL
const Obj = await apkmody.download("https://APKMODY_URL");
console.log(Obj);

Maker.

PhotoFunia.

import { photofunia } from "@xct007/frieren-scraper";

// get list all effects key.
const ArrObj = await photofunia.listEffects();
console.log(ArrObj);

// Generate text on image by key
const key = "balloon".
const Obj = await photofunia.create(key, {
  type: "text", // pass type as text.
  input: "Text should generate"
});
console.log(Obj);

// Image filter
const key = "the-frame".
const Obj = await photofunia.create(key, {
  type: "image", // pass type as image.
  // input only accept Buffer
  input: fs.readFileSync("./path_image.jpg") // LOL af
});
console.log(Obj);

Image Diffusion.

import { diffusion } from "@xct007/frieren-scraper";
import { writeFileSync } from "fs";

// stable diffusion.
const prompt = "1girl, blush, looking to viewer, warm smile,";
const seed = 123456789; // (optional). default random.

const Obj = await diffusion.stable(prompt, seed);
console.log(Obj);
/*
  {
    process_time: Number,
    seed: "String",
    ext: "String",
    mimetype: "String",
    base64Img: "String" // encodedBase64
  }
*/

// example save to disk
const saveFilename = `./image.${Obj.ext}`;

const buffer = Buffer.from(Obj.base64Img, "base64");

writeFileSync(saveFilename, buffer);

// Anime diffusion will be added
// if this repo star reach >= 50.

type

type StableDiffusionResult = {
  process_time: number;
  seed: string;
  ext: string;
  mimetype: string;
  base64Img: string;
};

Nsfw

Bokepsin

import { bokepsin } from "@xct007/frieren-scraper";

// Get latest
const ArrObj = await bokepsin.latest();
console.log(ArrObj);

// search
const ArrObj = await bokepsin.search("query");
console.log(ArrObj);

// detail
const Obj = await bokepsin.latest("URL");
console.log(ArrObj);