Comments (11)
zip里看到了3个可执行文件 convert main index. 它们是从这个 github repo 的源代码里编译出来的吗?我应该如何编译呢?
(用源代码我比较放心;给我可执行文件我不敢用)
from cases.
如果是 Linux,试试 ulimit -n 10000
1024的文件描述符太小了,至少需要6000
from cases.
执行ulimit -n 10000
修改文件描述符大小后重新运行convert
,转换正常。
问题已解决
from cases.
"convert" 是什么命令?我得到:
Command 'convert' not found, but can be installed with:
sudo apt install graphicsmagick-imagemagick-compat # version 1.4+really1.3.38-1ubuntu0.1, or
sudo apt install imagemagick-6.q16 # version 8:6.9.11.60+dfsg-1.3ubuntu0.22.04.3
sudo apt install imagemagick-6.q16hdri # version 8:6.9.11.60+dfsg-1.3ubuntu0.22.04.3
我没看到跟导入数据相关的代码。
from cases.
@BenLin0 https://github.com/cncases/cases/releases
from cases.
@cncases 谢谢增加了编译的介绍。现在编译已经成功,开始 convert
在我的干净ubuntu22.04上,需要增加一个操作才编译成功:
sudo apt-get install clang
然后编译,就可以
target/release/convert config.toml
(location 等都已经如reame一样设置好)
from cases.
rocksdb 是否可以用redis替换?
from cases.
convert完成后只有186G,没有200G,如何确认index索引后数据是完整的?有没有check程序可以校验下?
目前支持web访问搜索了,就是不知道数据是否完整,2019年的结果最多
from cases.
好慢啊,index 足足跑了一个星期了,不知道什么时候会结束
2024-01-27T17:44:08.859373Z INFO index: 33034000 done, 438993
2024-01-27T17:44:25.275684Z INFO index: 33035000 done, 439009
2024-01-27T17:44:37.735553Z INFO index: 33036000 done, 439022
from cases.
@BenLin0 你电脑配置太低了吧,我加全文都没那么慢……
from cases.
@BenLin0 你电脑配置太低了吧,我加全文都没那么慢……
是我的硬盘太慢了;主硬盘快,但是有点小,所以我安排在副硬盘上;昨天终于把进程杀了,转移到主硬盘上跑, index大概跑了6小时,仅是标题,现在网站能工作了。
谢谢!
from cases.
Related Issues (10)
- 索引案件内容生成的页面链接不对
- 能否实现一下插入指定压缩包的新数据,以及插入数据更新索引的功能,谢谢 HOT 5
- 百度网盘链接已过期 HOT 1
- 运行`main`出错:Too many open files HOT 1
- rocksdb是否有docker部署方案? HOT 1
- 部署后无法被局域网内其他设备访问 HOT 1
- 断点续处理的问题 HOT 1
- convert无法断点续处理
- convert无法断点续处理
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cases.