GithubHelp home page GithubHelp logo

When a large amount of SQL is written every time, after about tens of thousands of entries, OpenLogReplicator does not work. about openlogreplicator HOT 7 CLOSED

bersler avatar bersler commented on May 28, 2024
When a large amount of SQL is written every time, after about tens of thousands of entries, OpenLogReplicator does not work.

from openlogreplicator.

Comments (7)

LoveChina-3000 avatar LoveChina-3000 commented on May 28, 2024

If it is "writer": {
"type": "file",
"name": "transactions.json",
"start-seq": 0
} Then there is no problem; if it is "writer": {
"type": "zeromq",
"uri": "tcp://0.0.0.0:50000"
} Or "writer": {
"type": "network",
"uri": "0.0.0.0:50000"
}Then it can only run more than 60,000, can I trouble you to check it out?

from openlogreplicator.

bersler avatar bersler commented on May 28, 2024

Can you provide a reproduction? What is large? I have tested transactions with 1M insert operations and all works fine.

from openlogreplicator.

LoveChina-3000 avatar LoveChina-3000 commented on May 28, 2024

yes,I User WriteFile is Ok,but when I use WriteStream to write zeromq or network ,It Stop at more than 60,000 message.

from openlogreplicator.

LoveChina-3000 avatar LoveChina-3000 commented on May 28, 2024

Can I help you see this problem

from openlogreplicator.

bersler avatar bersler commented on May 28, 2024

Last few versions had optimization which broke the protobuf code. I have made a few fixes in the version 0.9.18-beta.
Does the error still appear? I have tested with network protocol and transmitted 4.5M messages. And there was no problem.
Can you please share some details how to reproduce the error?

from openlogreplicator.

bersler avatar bersler commented on May 28, 2024

Any update @yetengfei? Does bug still appear in latest version?

from openlogreplicator.

bersler avatar bersler commented on May 28, 2024

Details missing how to reproduce Issue.

from openlogreplicator.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.