GithubHelp home page GithubHelp logo

searcher 搜索不到东西 about poseidon HOT 6 OPEN

chy373 avatar chy373 commented on May 18, 2024
searcher 搜索不到东西

from poseidon.

Comments (6)

guojun1992 avatar guojun1992 commented on May 18, 2024

ReadZip url=http://127.0.0.1:39997/read-hdfs?path=/home/poseidon/src/test/index/2017-03-16/textindex/part-00792.gz&offset=0&length=0

看读的这个url是不对的,offset和length是从memcache解析protocbuffer出来的字段,现在是默认值,应该是入memcache出错,或者这个分词在memcache没找到,贴一下入memcache的日志

from poseidon.

chy373 avatar chy373 commented on May 18, 2024

@guojun1992 嗯 我吧meta里的配置项改成redis了,因为用memcached的话searcher是报另外一个错:
2017/03/17 20:26:00 request filter =
2017/03/17 20:26:00 http://127.0.0.1:39610/service/meta/test/index/get
2017/03/17 20:26:00 http://127.0.0.1:39610/service/meta/test/index/get
2017/03/17 20:26:00
2017/03/17 20:26:00 map[]
2017/03/17 20:26:00 FetchIndex symc key map[]
2017/03/17 20:26:00 stored get key text17031600097610
2017/03/17 20:26:00 fetchIndexMeta token=2,storedGetError=dockey is not found
2017/03/17 20:26:00 FetchIndex routine field=text token=2 nil_data
2017/03/17 20:26:00 FetchIndex routine field=text token=2 docList.size=0
2017/03/17 20:26:00 SearchDocItems token 2 FetchIndex err=dockey is not found
2017/03/17 20:26:00 ---- 127.0.0.1:34573 handleSearch &{100 0 0 {2017-03-16 test map[text:2]}}, err=dockey is not found

我的redis配置是改成这样的:

test 业务的 Doc Meta 信息存储的NoSQL配置信息

[/service/meta/backend-store/doc/test]
timeout_ms = 3000
address = 127.0.0.1:6789
store_type = redis
password = 6288cfbe

test 业务的 Index Meta 信息存储的NoSQL配置信息

[/service/meta/backend-store/index/test]
timeout_ms = 3000
address = 127.0.0.1:6789
store_type = redis
password = 6288cfbefe

这样有问题么

我在index下执行sh bin/start.sh 2017-03-16生成index是没有报错的,hadoop任务全都执行成功了。我查看了下redis里好像没有多出来key,如果index生成成功的话,redis里会多出来键吧

from poseidon.

guojun1992 avatar guojun1992 commented on May 18, 2024

@chy373 是你入meta信息出错了

2017/03/17 20:26:00 stored get key text17031600097610
2017/03/17 20:26:00 fetchIndexMeta token=2,storedGetError=dockey is not found

从kvdb(memcache或者redis)没有找到text17031600097610这个key
1、确认redis是否能正常工作
2、贴一下meta的错误日志

from poseidon.

chy373 avatar chy373 commented on May 18, 2024

@guojun1992

  1. redis应该是正常工作的,因为idgenerator是正常工作的,redis里现在有一个test_20170316的key,应该是idgenerator生成的
  2. 很奇怪 meta下面是没有日志的,我如何确定meta是正常工作的,如果meta不是正常工作,生成index的hadoop任务不会报错么

from poseidon.

guojun1992 avatar guojun1992 commented on May 18, 2024

从你的描述看来,应该是build索引出错了,你确定build索引最后结果显示的是sucess吗?这里交流效率太低,加一下QQ群我们聊一下

from poseidon.

zhouyuan-dev avatar zhouyuan-dev commented on May 18, 2024

怎么解决的,这个能贴下嘛,我现在也是这个问题了。查不到数据,meta数据放到redis里面的

from poseidon.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.