GithubHelp home page GithubHelp logo

iidr-ue-kcop's People

Contributors

fketelaars avatar ziejatom avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

iidr-ue-kcop's Issues

Timestamp format from IIDR-UE-KCOP

Hi Frank, how are you?

I'm using your IIDR-UE-KCOP, but I got in the code at KcopLiveAuditJson.java:

/*
 * Append the apply timestamp
 */
private void addApplyTimestamp(JsonObject kafkaAuditJson) {
	String timeStamp = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss.SSS000").format(new Date());
	kafkaAuditJson.addProperty(applyTimestampColumn, timeStamp);
}

This bring me the format always with rounding, but in correct format. If I use the timestamp from IIDR, it bring me without the rounding but with an incorrect form:

"2018-06-29-07.42.53.936336" - Default from IIDR
"2018-06-29 07:40:56.446000" - Your UE KCOP

Is it possible change the rounding to bring the exactly time without the rounding?

Handle invalid journal control columns

Build in handling for invalid journal control columns which have been specified in the properties file. Non-existing JCCs must be ignored and a warning message must be issued to the event log.

Maintain order of columns in JSON keys and values

Even though ordering of JSON keys is not relevant for parsing and extracting the values, maintaining the order makes it easier to validate the correct output. Instead of adding JsonObject keys, create a LinkedHashMap to hold the current change record's audit columns and column values.

Error trying to configure User Exit in Management Console

Hi there,

When I try to configure the User Exit for the subscription I keep getting an error:

An error in User Exit com.ibm.replication.cdc.userexit.kcop.KcopLiveAuditJson.
Error: com.datamirror.ts.target.publication.userexit.kafka.KafkaCustomOperationProcessorIF

That's all there is to the error, can't see the java exception if there is one.

image

image

I'm running Version: 11.4.10014

I'd really appreciate any assistance you can provide as we're trying to get this working for a POC project.

Thanks
Liz

Writing to multiple partitions

Frank

We happened to look through your code since we have a need to customize the message prior to sending it to the Kafkaproducer.
Noticed that the KcopRoundRobinPartitioner writes only to partition 0. We would like the ability to write to multiple partitions(for different keys). Is that something which we can customize this KcopRoundRobinPartitioner or is there some other upstream limitation/configuration that needs to also be made. I had increased the partition count on the broker side but found that it always go to the same partition and then looked at this code/documentation
Any advice/pointers would be helpful

Thanks
Meena

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.