GithubHelp home page GithubHelp logo

Comments (8)

coldear avatar coldear commented on September 26, 2024 1

This is exactly what I am looking for.
Ideally, when user request to destroy current processor, KCL should be able to create a new one for the same shards and start to process from the last checkpoint.

from amazon-kinesis-client.

vlanka avatar vlanka commented on September 26, 2024

Thanks for your feedback. We will look into adding this support in the future.

from amazon-kinesis-client.

ridha avatar ridha commented on September 26, 2024

+1

from amazon-kinesis-client.

rhodey avatar rhodey commented on September 26, 2024

you can accomplish this pretty easily with Guava's ListenableFuture or Java8's CompletableFuture & the factory pattern & I'm happier with this being app-specific logic instead of something forced by the library-- amz has a history of doing threading & executors weird :/

you already have to implement IRecordProcessorFactory so give yourself a base abstract pattern to start, like my KinesisRecordConsumerFactory

my KinesisRecordConsumer has some application specific stuff in there but you should be able to get the idea.

then in your main class add a callback to KinesisRecordConsumerFactory.getErrorFuture() & kill your app or shutdown your worker or whatever you want.

from amazon-kinesis-client.

jqr avatar jqr commented on September 26, 2024

It would be great for the MLD to have this as well. We're currently calling exit(1) which works, but also causes the whole MLD to die, taking all owned shards with it. Restarting with workerId means these come back up quickly, but it's overkill.

from amazon-kinesis-client.

pfifer avatar pfifer commented on September 26, 2024

Thanks for reporting this. We're investigating this feature, and will prioritize with other feature requests.

Others - Please comment or add your reaction to this post so our team is aware of how to prioritize this change.

from amazon-kinesis-client.

BobbyJohansen avatar BobbyJohansen commented on September 26, 2024

I would agree with this seems like an important piece of functionality to provide to the implementer

from amazon-kinesis-client.

zeynepsu avatar zeynepsu commented on September 26, 2024

We're tracking this internally. Closing this issue.

from amazon-kinesis-client.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.