Comments (6)
看读的这个url是不对的,offset和length是从memcache解析protocbuffer出来的字段,现在是默认值,应该是入memcache出错,或者这个分词在memcache没找到,贴一下入memcache的日志
from poseidon.
@guojun1992 嗯 我吧meta里的配置项改成redis了,因为用memcached的话searcher是报另外一个错:
2017/03/17 20:26:00 request filter =
2017/03/17 20:26:00 http://127.0.0.1:39610/service/meta/test/index/get
2017/03/17 20:26:00 http://127.0.0.1:39610/service/meta/test/index/get
2017/03/17 20:26:00
2017/03/17 20:26:00 map[]
2017/03/17 20:26:00 FetchIndex symc key map[]
2017/03/17 20:26:00 stored get key text17031600097610
2017/03/17 20:26:00 fetchIndexMeta token=2,storedGetError=dockey is not found
2017/03/17 20:26:00 FetchIndex routine field=text token=2 nil_data
2017/03/17 20:26:00 FetchIndex routine field=text token=2 docList.size=0
2017/03/17 20:26:00 SearchDocItems token 2 FetchIndex err=dockey is not found
2017/03/17 20:26:00 ---- 127.0.0.1:34573 handleSearch &{100 0 0 {2017-03-16 test map[text:2]}}, err=dockey is not found
我的redis配置是改成这样的:
test 业务的 Doc Meta 信息存储的NoSQL配置信息
[/service/meta/backend-store/doc/test]
timeout_ms = 3000
address = 127.0.0.1:6789
store_type = redis
password = 6288cfbe
test 业务的 Index Meta 信息存储的NoSQL配置信息
[/service/meta/backend-store/index/test]
timeout_ms = 3000
address = 127.0.0.1:6789
store_type = redis
password = 6288cfbefe
这样有问题么
我在index下执行sh bin/start.sh 2017-03-16生成index是没有报错的,hadoop任务全都执行成功了。我查看了下redis里好像没有多出来key,如果index生成成功的话,redis里会多出来键吧
from poseidon.
@chy373 是你入meta信息出错了
2017/03/17 20:26:00 stored get key text17031600097610
2017/03/17 20:26:00 fetchIndexMeta token=2,storedGetError=dockey is not found
从kvdb(memcache或者redis)没有找到text17031600097610这个key
1、确认redis是否能正常工作
2、贴一下meta的错误日志
from poseidon.
- redis应该是正常工作的,因为idgenerator是正常工作的,redis里现在有一个test_20170316的key,应该是idgenerator生成的
- 很奇怪 meta下面是没有日志的,我如何确定meta是正常工作的,如果meta不是正常工作,生成index的hadoop任务不会报错么
from poseidon.
从你的描述看来,应该是build索引出错了,你确定build索引最后结果显示的是sucess吗?这里交流效率太低,加一下QQ群我们聊一下
from poseidon.
怎么解决的,这个能贴下嘛,我现在也是这个问题了。查不到数据,meta数据放到redis里面的
from poseidon.
Related Issues (20)
- idgenerator flag redefined: log_dir HOT 13
- 安装poseidon/docs/get_started.md 里面的步骤做,数据检索不出来 HOT 4
- 可视化界面 HOT 2
- Poseidon遇到的问题 HOT 16
- poseidon集成hdfs的问题汇总及解决方法 HOT 8
- Caused by: java.lang.VerifyError: class proto.PoseidonIf$DocIdList$Builder HOT 3
- 执行/bin/bash bin/mock_start.sh 2016-12-12失败 HOT 1
- 有docker 部署的完整方案么? HOT 1
- CommonLogParser解析时候每个tokenizer的分别输出 HOT 1
- doc meta setter map reduce test 2017-02-17 failed HOT 1
- 请问一下,poseidon和es有什么区别吗,谢谢 HOT 1
- 2019/10/31 20:39:14 logto_hdfs_collector.go:754: MAIN [ERROR] LogtoHdfsCollector.copySingleFileToHdfs mkdir err, remoteDir: /home/poseidon/src/test/docid/2019-10-30, remotePath: /home/poseidon/src/test/docid/2019-10-30/0_n3_1031202219_2019-10-30-20-00.gz, retry: 180, err: exit status 1 HOT 2
- handleSearch &{100 0 0 {2019-11-04 test map[text:3599021455585075]}}, err=dockeys is null HOT 2
- MapReduce 可以提高并行度吗,索引生成有点慢
- Documentation in English HOT 1
- 使用hdfs的bug(将mock_local置为false) HOT 8
- 说几个快速开始的问题 HOT 3
- Offline Installation HOT 1
- 文档倒排索引构建问题 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from poseidon.