lizheming / doumark-action

Douban movie/book/music/game marked data sync GitHub Action | 豆瓣观影/阅读/音乐/游戏记录同步

👋 Introduction

Hi guys, I'm Li Zheming. I am a JavaScript developer from Beijing, China. I'm currently working on @75team as a Font-End engineer.
I have some works with JavaScript, Node.js and SVG, contact me if you have same interesting or some questions!

📫 Contact Me on Social Media

Facebook | Sina Weibo | Zhihu | SegmentFault | V2EX or just ✉️ Email | 💬 Issue Me about everything!

💡 Projects with My Work

• 75.team: The Official Blog for 75team, the largest front end team in @Qihoo360.
• 75CDN: The best CDN for web related libraries to speed up your websites, mirror from @cdnjs.
• 声享: Create and share your presentations online.

📚 Tech Articles and Talks

You can find a list of my talks' presentation on 📖 ppt.baomitu.com.

And get all my post articles in my blog 📝 zh.eming.li.

💻 Open Source Work Stats

doumark-action's Issues

执行失败

你好，今天发现获取豆瓣频繁失败，能帮忙看一下原因吗？谢谢
https://github.com/wangdaodao/wangdaodao/actions
https://github.com/conge/conge.github.io/actions
https://github.com/Yana-Hangabina/crap.hongb.in/actions
https://github.com/lmm214/immmmm/actions

[Bug] Sync to Notion failed

The database id and notion integrantion token are correct.

https://github.com/eallion/eallion.com/actions/runs/5632390673/job/15260293179

    - name: Sync Movie to Notion
      uses: lizheming/doumark-action@master
      with:
        id: eallion
        type: movie
        format: notion
        dir: cbbdf33235e64061a7ddb6716217f8a9
        notion_token: ${{ secrets.NOTION_ACCESS_TOKEN }}

@notionhq/client warn: request fail {
  code: 'validation_error',
  message: 'body failed validation. Fix one:\n' +
    'body.properties.id.title should be defined, instead was `undefined`.\n' +
    'body.properties.id.rich_text should be defined, instead was `undefined`.\n' +
    'body.properties.id.number should be a number or `null`, instead was `"30433455"`.\n' +
    'body.properties.id.url should be defined, instead was `undefined`.\n' +
    'body.properties.id.select should be defined, instead was `undefined`.\n' +
    'body.properties.id.multi_select should be defined, instead was `undefined`.\n' +
    'body.properties.id.people should be defined, instead was `undefined`.\n' +
    'body.properties.id.email should be defined, instead was `undefined`.\n' +
    'body.properties.id.phone_number should be defined, instead was `undefined`.\n' +
    'body.properties.id.date should be defined, instead was `undefined`.\n' +
    'body.properties.id.checkbox should be defined, instead was `undefined`.\n' +
    'body.properties.id.relation should be defined, instead was `undefined`.\n' +
    'body.properties.id.files should be defined, instead was `undefined`.\n' +
    'body.properties.id.status should be defined, instead was `undefined`.\n' +
    'body.properties.title.id should be defined, instead was `undefined`.\n' +
    'body.properties.title.name should be defined, instead was `undefined`.\n' +
    'body.properties.title.start should be defined, instead was `undefined`.'
}
/snapshot/drone-doumark/node_modules/@notionhq/client/build/src/errors.js:162
        return new APIResponseError({
               ^

APIResponseError: body failed validation. Fix one:
body.properties.id.title should be defined, instead was `undefined`.
body.properties.id.rich_text should be defined, instead was `undefined`.
body.properties.id.number should be a number or `null`, instead was `"30433455"`.
body.properties.id.url should be defined, instead was `undefined`.
body.properties.id.select should be defined, instead was `undefined`.
body.properties.id.multi_select should be defined, instead was `undefined`.
body.properties.id.people should be defined, instead was `undefined`.
body.properties.id.email should be defined, instead was `undefined`.
body.properties.id.phone_number should be defined, instead was `undefined`.
body.properties.id.date should be defined, instead was `undefined`.
body.properties.id.checkbox should be defined, instead was `undefined`.
body.properties.id.relation should be defined, instead was `undefined`.
body.properties.id.files should be defined, instead was `undefined`.
body.properties.id.status should be defined, instead was `undefined`.
body.properties.title.id should be defined, instead was `undefined`.
body.properties.title.name should be defined, instead was `undefined`.
body.properties.title.start should be defined, instead was `undefined`.
    at buildRequestError (/snapshot/drone-doumark/node_modules/@notionhq/client/build/src/errors.js:162:16)
    at Client.request (/snapshot/drone-doumark/node_modules/@notionhq/client/build/src/Client.js:304:54)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at async NotionStore.set (/snapshot/drone-doumark/src/store/notion.js)
    at async exec (/snapshot/drone-doumark/src/plugin.js) {
  code: 'validation_error',
  status: 400,
  headers: Headers {
    [Symbol(map)]: [Object: null prototype] {
      date: [ 'Sat, 22 Jul 2023 19:36:03 GMT' ],
      'content-type': [ 'application/json; charset=utf-8' ],
      'transfer-encoding': [ 'chunked' ],
      connection: [ 'close' ],
      'x-powered-by': [ 'Express' ],
      etag: [ 'W/"538-B+r9PT+5bLSUBLrM9I+WlZ/Jetc"' ],
      vary: [ 'Accept-Encoding' ],
      'content-encoding': [ 'gzip' ],
      'cf-cache-status': [ 'DYNAMIC' ],
      'set-cookie': [
        '__cf_bm=n5niPrEE00_RYXhuKTmf8S18bBeuDRqryl23v3B4Paw-1690054563-0-ATN28XEhSXy++SK4BEybTjmrCG/2SoI6fl3p3XrsOTFLkXHMjChq0h3nRsAc6jOhvA8ElFBCwaeLXyrUlnPVRqI=; path=/; expires=Sat, 22-Jul-23 20:06:03 GMT; domain=.notion.com; HttpOnly; Secure; SameSite=None'
      ],
      server: [ 'cloudflare' ],
      'cf-ray': [ '7eae2[15](https://github.com/eallion/eallion.com/actions/runs/5632390673/job/15260293179#step:6:16)ebcf50bfb-DFW' ]
    }
  },
  body: '{"object":"error","status":400,"code":"validation_error","message":"body failed validation. Fix one:\\nbody.properties.id.title should be defined, instead was `undefined`.\\nbody.properties.id.rich_text should be defined, instead was `undefined`.\\nbody.properties.id.number should be a number or `null`, instead was `\\"[30](https://github.com/eallion/eallion.com/actions/runs/5632390673/job/15260293179#step:6:31)4[33](https://github.com/eallion/eallion.com/actions/runs/5632390673/job/15260293179#step:6:34)[45](https://github.com/eallion/eallion.com/actions/runs/5632390673/job/15260293179#step:6:46)5\\"`.\\nbody.properties.id.url should be defined, instead was `undefined`.\\nbody.properties.id.select should be defined, instead was `undefined`.\\nbody.properties.id.multi_select should be defined, instead was `undefined`.\\nbody.properties.id.people should be defined, instead was `undefined`.\\nbody.properties.id.email should be defined, instead was `undefined`.\\nbody.properties.id.phone_number should be defined, instead was `undefined`.\\nbody.properties.id.date should be defined, instead was `undefined`.\\nbody.properties.id.checkbox should be defined, instead was `undefined`.\\nbody.properties.id.relation should be defined, instead was `undefined`.\\nbody.properties.id.files should be defined, instead was `undefined`.\\nbody.properties.id.status should be defined, instead was `undefined`.\\nbody.properties.title.id should be defined, instead was `undefined`.\\nbody.properties.title.name should be defined, instead was `undefined`.\\nbody.properties.title.start should be defined, instead was `undefined`."}'
}

数据更新逻辑

请问数据的更新逻辑是怎么样的呢？
我douban那边标记更新好几天了，但是通过doumark抓取的数据还没有更新。

想看/正在看

如何才能获取想看的电影 /书，或者正在看的电影/书

偶尔触发报错

node:internal/process/promises:246
          triggerUncaughtException(err, true /* fromPromise */);
          ^
ConnectTimeoutError: Connect Timeout Error
    at Timeout.onConnectTimeout [as _onTimeout] (/snapshot/douban/node_modules/undici/lib/core/connect.js:103:24)
    at listOnTimeout (node:internal/timers:559:11)
    at processTimers (node:internal/timers:500:7) {
  code: 'UND_ERR_CONNECT_TIMEOUT'
}

请教一下，偶尔执行的时候会报错。

个人化评论评分数据？

我尝试了一下这个action，good work！

我有个问题：目前，似乎存下来的数据，都是书籍的基本数据和大众评分星级数据

不知道能不能把个人的评分，标签和简评数据也拿下来？

谢谢

更新报错，麻烦看一下。

不知道为什么，总是出现如下问题，问了其他也用这个脚本的小伙伴，就没遇见。

关于豆瓣图片无法直接使用的说明

最近豆瓣对 CDN 的防盗链做了策略升级，外站无法直接使用豆瓣图片地址加载了。
为了解决这个问题，我这里制作了个豆瓣海报的托管服务，图片地址规则如下：

https://dou.img.lithub.cc/<movie|book|music>/<id>.jpg

例如：https://dou.img.lithub.cc/movie/35769236.jpg

是否可增加文章中单条数据的渲染

比如某篇文章中以hugo的短代码模式插入豆瓣链接，自动查询csv对应的数据并渲染成html