GithubHelp home page GithubHelp logo

Comments (11)

BenLin0 avatar BenLin0 commented on August 21, 2024 1

zip里看到了3个可执行文件 convert main index. 它们是从这个 github repo 的源代码里编译出来的吗?我应该如何编译呢?

(用源代码我比较放心;给我可执行文件我不敢用)

from cases.

cncases avatar cncases commented on August 21, 2024

如果是 Linux,试试 ulimit -n 10000

1024的文件描述符太小了,至少需要6000

from cases.

KezhiAdore avatar KezhiAdore commented on August 21, 2024

执行ulimit -n 10000修改文件描述符大小后重新运行convert,转换正常。
问题已解决

from cases.

BenLin0 avatar BenLin0 commented on August 21, 2024

"convert" 是什么命令?我得到:

Command 'convert' not found, but can be installed with:
sudo apt install graphicsmagick-imagemagick-compat # version 1.4+really1.3.38-1ubuntu0.1, or
sudo apt install imagemagick-6.q16 # version 8:6.9.11.60+dfsg-1.3ubuntu0.22.04.3
sudo apt install imagemagick-6.q16hdri # version 8:6.9.11.60+dfsg-1.3ubuntu0.22.04.3

我没看到跟导入数据相关的代码。

from cases.

cncases avatar cncases commented on August 21, 2024

@BenLin0 https://github.com/cncases/cases/releases

from cases.

BenLin0 avatar BenLin0 commented on August 21, 2024

@cncases 谢谢增加了编译的介绍。现在编译已经成功,开始 convert
在我的干净ubuntu22.04上,需要增加一个操作才编译成功:
sudo apt-get install clang

然后编译,就可以
target/release/convert config.toml
(location 等都已经如reame一样设置好)

from cases.

xinmans avatar xinmans commented on August 21, 2024

rocksdb 是否可以用redis替换?

from cases.

xinmans avatar xinmans commented on August 21, 2024

convert完成后只有186G,没有200G,如何确认index索引后数据是完整的?有没有check程序可以校验下?

目前支持web访问搜索了,就是不知道数据是否完整,2019年的结果最多

from cases.

BenLin0 avatar BenLin0 commented on August 21, 2024

好慢啊,index 足足跑了一个星期了,不知道什么时候会结束

2024-01-27T17:44:08.859373Z INFO index: 33034000 done, 438993
2024-01-27T17:44:25.275684Z INFO index: 33035000 done, 439009
2024-01-27T17:44:37.735553Z INFO index: 33036000 done, 439022

from cases.

cncases avatar cncases commented on August 21, 2024

@BenLin0 你电脑配置太低了吧,我加全文都没那么慢……

from cases.

BenLin0 avatar BenLin0 commented on August 21, 2024

@BenLin0 你电脑配置太低了吧,我加全文都没那么慢……

是我的硬盘太慢了;主硬盘快,但是有点小,所以我安排在副硬盘上;昨天终于把进程杀了,转移到主硬盘上跑, index大概跑了6小时,仅是标题,现在网站能工作了。

谢谢!

from cases.

Related Issues (10)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.