Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

东财数据维护 #13

Closed
foolcage opened this issue Jul 8, 2019 · 4 comments
Closed

东财数据维护 #13

foolcage opened this issue Jul 8, 2019 · 4 comments

Comments

@foolcage
Copy link
Member

foolcage commented Jul 8, 2019

目前东财数据的recorder没有开源,为了该数据源能够更长久的使用,打算使用基础数据+patch中转更新的方式来提供.

基础数据(到2019-07-06):

https://pan.baidu.com/s/17iLVJDcRnmu-LgRGFqItNA

提取码: pv9d

增量数据更新方案:
可以使用sqlite diff工具来生成diff,把diff单独放一个repo,或者自己的服务器,或者ocs

@buginux
Copy link
Contributor

buginux commented Jul 9, 2019

感觉可以用 git lfs 来做,直接使用 git 跟踪也比较方便,省得还要手动打 patch。

git lfs 可以将大文件单独存放,然后用 git 来跟踪变化:https://github.com/git-lfs/git-lfs/wiki/Tutorial

@foolcage
Copy link
Member Author

foolcage commented Jul 9, 2019

@buginux
之前用过,那时推荐大小40M以下,就放弃了.目前看起来可以到2G,看来可以满足需求.
打算单独开一个repo来存数据.

@buginux
Copy link
Contributor

buginux commented Jul 10, 2019

是的,看了下 2GB 是 Github 的限制,不知其它平台是否也有类似的限制。

@foolcage
Copy link
Member Author

已全部开源,基础数据在最新文档里有说明,大家只需要使用代码里的脚本做增量更新。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants