GithubHelp home page GithubHelp logo

创建持久化索引,每分钟只能写3000-5000条数据,请问正常吗?Create a persistent index, only write 3000-5000 data per minute. Is it normal? about riot HOT 5 CLOSED

go-ego avatar go-ego commented on June 26, 2024
创建持久化索引,每分钟只能写3000-5000条数据,请问正常吗?Create a persistent index, only write 3000-5000 data per minute. Is it normal?

from riot.

Comments (5)

vcaesar avatar vcaesar commented on June 26, 2024

First, searcher.Flush() only needs to be called once, and then you

searcher.Init(types.EngineOpts{
    // Using: using,
    StorageShards: storageShards,
    NumShards: numShards,
})

configure Coroutines.

from riot.

duomi avatar duomi commented on June 26, 2024

@vcaesar Do you mean that my coroutines are not running? Can you describe more clearly?

from riot.

vcaesar avatar vcaesar commented on June 26, 2024

I mean is that you can configure the number of coroutines for storage to increase speed.

from riot.

duomi avatar duomi commented on June 26, 2024

I has already use loop to run 100 coroutines, did i use it in a wrong way?
So what's the correct way,can you show me,please?@vcaesar

from riot.

karfield avatar karfield commented on June 26, 2024

@Cliff2016 Using internal sharding instead of fork routines with calling IndexDoc, it's not called "parallel processing". 并发的调用一个接口并不等于让内部分片产生效果,顶多是频繁调用接口,而且跟糟糕的是调用完了还去 flush 一下. You need to think like a program. 一个引擎 indexing 真正工作慢的原因往往在于io,所以没事不要去flush,这个引擎内部有分片机制,那就多用用这个机制,来提升效率。

from riot.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.