GithubHelp home page GithubHelp logo

tbdsux / kuryana Goto Github PK

View Code? Open in Web Editor NEW
48.0 4.0 16.0 84 KB

A serverless web scraper api for MyDramaList.com

Home Page: kuryana.vercel.app

License: MIT License

Python 83.14% HTML 16.86%
scraper scraper-api bs4 mdl-scraper mydramalist vercel serverless python-serverless

kuryana's Introduction

kuryana

A simple MyDramaList.com scraper api.

This scrapes on the go so it might be slow.

THIS SERVICE IS ONLY CREATED TO SATISFY THE NEED FOR AN API FOR [MYDRAMALIST.COM](https://mydramalist.com). THIS WILL BE STOPPED ONCE AN OFFICIAL API WILL BE RELEASED.

Deploy Your Own

Deploy with Vercel

API Use

https://kuryana.vercel.app/search/q/{yourquery}
https://kuryana.vercel.app/id/{mydramalist-slug}
https://kuryana.vercel.app/id/{mydramalist-slug}/cast
https://kuryana.vercel.app/id/{mydramalist-slug}/reviews
https://kuryana.vercel.app/people/{people-id}
https://kuryana.vercel.app/seasonal/{year}/{quarter}
https://kuryana.vercel.app/list/{id}
https://kuryana.vercel.app/dramalist/{user_id}

Error Messages

// mainly on all endpoints except `search`
// sample: /list/unknown-random-id
{
  "code": 400,
  "error": true,
  "description": {
    "title": "This list is private.",
    "info": "You can see this page because the URL you are accessing cannot be found."
  }
}
// could also be this (only on `/search`) endpoint
{
  "error": true,
  "code": 404,
  "description": "404 Not Found"
}

Development

  • Minimum Python Version : 3.9,

  • Always make sure to create a virtualenvironment

    python -m venv venv
    source ./venv/bin/activate.sh # change depends on your shell and os
  • Install the dependencies

    pip install -r requirements.txt

Dev Server

You can start the development server in two ways:

  • Using the vercel CLI (localhost:3000)

    vercel dev
    • The api will be http://localhost:3000/api/*
  • Or with uvicorn (localhost:8000)

    uvicorn api.main:app --reload
    • The api will be http://localhost:8000/*

NOTE

All Requests and SCRAPED Datas are not cached by Vercel or the API itself.

© TheBoringDude

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.