• 背景

目前有大量海外、武汉本地志愿者团队使用我们的平台录入数据，他们会自己维护一些表格，可能会有重复数据，此时我们在获取我们自己的数据之前，需要获取到他们的数据，并在我们的数据获取后根据某些字段进行去重，以他们的数据为准（因为一线志愿者的数据更加准确）。

• 思路

可以在 TableConfig 中加入 PreTable，支持链式的前置数据表，在获取表数据前，需要根据 PreTable 来获取数据，并按照给定规则，在获取到本表数据后在前置表中查询数据，如果查到，就替换当前表数据行

方便别的开发者进行协作

已经实现，导出石墨文档为 excel，并读取为数组。

https://github.com/yangkghjh/shimo2csv

const task = {
    name: "HOTEL",
    type: "sheet",
    guid: "GJKh3RTPRcwJcYWK",
};

shimo2csv(task, config.Cookie, {
    ColNum: 7,
    StartRow: 4,    
    StartCol: 1,
}).then((data) => {
    console.log(data);
});

[[
    'B武昌区',
    40,
    '城市便捷武汉徐东店',
    15871789308,
    '王小华',
    '',
    '',
    '无人接听',
    '',
    '湖北省武汉市武昌区 宏祥路1号'
  ],
... 181 more items
]

husky可以利用git hooks在提交代码时做一些lint上的操作。

这样子可以减少因为代码格式导致ci不通过的问题

import * as Octokit from '@octokit/rest';

改成

import { Octokit }  from '@octokit/rest';

您的问题

I can browser the data directly in browser using the shimo link. So I wonder if it is necessary to login in the code.

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

对于数据列，添加 Type 信息，例如 Type 为 addr 、contact 等时，进行额外预处理。

addr 可以通过地图接口获取经纬度信息存入。
contact 按格式进行预处理，方便前端分离数据。

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 1 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

1. 在issues面板中点击New issue。

2. 填写issue的Title，Title格式为："[需求类型]需求标题"，如：“[Feature] 添加一个新特性”。请按所规定的需求类型进行填写，可选的需求类型有：Feature、Enhancement、Bug。（如需要添加新的需求类型，请联系项目管理员）
   当发布issue后，机器人将会自动添加label。

3. 填写issue的内容，描述需求的详细内容，支持markdown格式。

4. 点击submit new issue按钮即可发布issue。需要认领issue的同学请回复/self-assign。

Issue示例如图

https://shimo.im/sheets/8TxQ8CRh8JYyHCGh/rlbJH

需要修改数据落仓结构，改为架构文档中描述的结构

目前数据更新后会推送到 GitHub 数据仓库中，但前端直接使用时非常不便，速度无法保障，故目前在数据更新后同时推送到 CDN 上，以便可以使用

物流数据 logistical/data.json，为了同时兼容旧版本页面，原来的allowPersonal字段保持不变，新增bool类型的allowPersonalBool字段，后续新增的是否类型的字段将更新为bool型，不再使用“是,否"直接输出

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

解决中文版readme文件无法显示架构图的bug，需要提交中文版的架构图到static路径

描述功能要求

需要全局缓存来提供缓存能力，例如 Redis 或内存缓存均可。

场景：在对地址进行经纬度转换时，需要有全局缓存来尽量保证不需要反复发起请求。

如果有的话，请附图

额外的信息

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

拆分现有不合理的 service，目前石墨到 GitHub 的同步均写在 github.ts 的 service 中，应该单独拆分为 shimo.ts service。

描述功能要求

需求文档：https://shimo.im/docs/jRd9G9J6RwH6vXTv/ 《迭代版义诊模块》
迭代版：
目标用户：
1.患有轻症呼吸道疾病怀疑自己感染的普通民众，但一方面由于担心前往医院交叉感染，另一方面想要寻求专业建议（用药和是否就诊）

2.其他疾病需要寻求医生建议的患者（非急症/非重症），希望得到医生建议

改进点：
增加了标签功能，标签分类为：新冠义诊（仅接受新冠相关问诊），心理咨询（疫情期间的心理咨询），义诊&心理（可以接受新冠义诊和心理咨询的义诊单位），其他（其他类型的义诊单位）

交互框架：
点击主网站义诊tab——进入义诊界面——义诊界面显示义诊单位，下拉显示更多义诊单位——一个搜素框（支持模糊搜素），四个标签，首次进入默认标签显示新冠义诊单位，点击每一个标签会按照对应的标签显示义诊单位

如果有的话，请附图

更加详细的UI设计稿：
https://www.figma.com/file/4HEcNdhYXrFo38Jjn4cQPO/%E4%B9%89%E8%AF%8A?node-id=66%3A0
义诊模块的数据：
https://shimo.im/sheets/JgXjYCJJTRQxJ3GP/MODOC/

目前该项目仅支持 GitHub 的数据落仓，需要支持 Gitee 落仓，可以选择任意落仓方式

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

添加文档的 Schema 信息，目前已包含医院、宾馆、物流表，还需添加如下几张表

• 捐赠
• 生产
• 义诊

描述功能要求

https://shimo.im/sheets/qZx7ltnDo0I9BSLD/8U70d, which is a table about a non-profit program.
To fetch the table data to github without changing the table itself. The code base should be slightly modified.

目前解析程序在解析表格数据时，当某单元格的格式错误时，会认为该行数据有误而直接丢弃，导致错误无法被发现，需要在发生错误时，记录其所在表格、所在分表、所在行和列，以保证可以快速定位修复内容错误。

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

目前文档中的架构图无法查看，需要密码，建议使用 plantmul 进行绘制。

@bkbabydp 请在 Issue 中粘贴一下现有架构图，我来改为 plantuml 文件和实时渲染，以保证可随时更新

同步过程中可以根据地址文字处理出经纬度信息，方便后续数据分析和可视化

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

您的问题

It seems that we can use the code of this repo to fetch the data from shimo and push them to a github repository. The frontend code uses these json data. But the frontend code is not deployed to github pages. So my question is why we need to push the data to github.

目前，无论文件内容是否发生变化，都会导致提交，如果内容未变，则会产生一个空的 commit，这个是完全没有必要的，在拿 SHA 时会同时返回当前文件内容，可以检查是否变化，未变化则不再提交

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 12 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

进一步优化 Format 能力，添加对类型和默认值的支持

描述功能要求

参考其他已有表，接入湖北料人员指定休息酒店表
表地址：https://shimo.im/sheets/Hd9C3QytrJK3RWxG
需要注意：

• 需要接入所有各市分表，具体方式可以参考 table_hospital
• 所有 type 目前都已支持，仅需在 schema 中增加对应的配置
• 需要注意联系人和联系电话被分列了，feParser 中需要合并成目前的 contacts 格式

如果有的话，请附图

额外的信息

使用 /self-assign 认领任务

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 27 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

Contributors Overview

It is data-sync team's great honor to have new contributors from community. We really appreciate your contributions. Feel free to tell us if you have any opinion and please share this open source project with more people if you could. If you hope to be a contributor as well, please start from https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .
Here is the list of new contributors:

@bkbabydp

@WuShaoling

@HemingLin

@tyisme614

@damingerdai

@frank-zsy

@WangSiman-Carol

Thanks to you all.

为每个 Table 增加一个解析器，解析数据为前端可展示的数据格式

README

目前只是介绍了项目框架，但是并没有描述具体的数据内容（医院？地图？）。我觉得加上一个数据介绍会更直观一些。

石墨由于访问量问题，可能偶现请求超时，需要增加超时或服务器内部错误重试机制。

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 0 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

需要能够定时采集其他 API 的数据，然后用落仓。

对方需要提供一个数据内容说明、API 地址、数据格式说明、一个访问凭证，我们即可开始采集他们的数据。

Weekly Report of data-sync

This is a weekly report of data-sync. It summarizes what have changed in the project during the passed week, including pr merged, new contributors, and more things in the future.

Repo Overview

Basic data

Baisc data shows how the watch, star, fork and contributors count changed in the passed week.

Issues & PRs

Issues & PRs show the new/closed issues/pull requests count in the passed week.

PR Overview

Thanks to contributions from community, 9 pull requests was merged in the repository last week. They are:

Code Review Statistics

data-sync encourages everyone to participant in code review, in order to improve software quality.
This robot would automatically help to count pull request reviews of single github user as the following every week. So, try to help review code in this project.

New Contributors

We have no new contributors in this project this week.
data-sync team encourages everything about contribution from community.
For more details, please refer to https://github.com/wuhan2020/data-sync/blob/master/CONTRIBUTING.md .

当前问题

I have setup both the github repo and shimo SDK token. And I can successfully synchronize the hospital table. However, the synchronization of clinicTable failed. Maybe there is some problems with the schema of clinicTable.