Comments (5)
The included confluent serde currently expects to find a local copy of the schema on the classpath when serializing a message but not when deserializing the message. This behavior is inherited from upstream Serializer.
If it can't find one, that might be why it is throwing an error (admittedly not the most informative). In earlier versions, it would have thrown an error at resolution time but this PR relaxed that a bit so that consumers are not required to provide one.
Try putting those avro files on the resource-path (i.e. assuming a standard lein project layout, in the files resources/avro_key.json
and resources/avro_value.json
).
from jackdaw.
Thank you for your reply! Actually the schema files are already under the resources dir. When they're not, the friendlier exception "Execution error (ExceptionInfo) at jackdaw.serdes.resolver/load-schema (resolver.clj:18).
Could not find schema key_schema.json" is thrown
from jackdaw.
Updated OP, using confluent platform for better reproducibility.
from jackdaw.
Ah ok sorry. Our confluent serde expects keys in the message and value maps to be keyword, hyphenated versions of the corresponding avro fields.
There is #126 which seeks to provide the option to not mangle the names in this way.
from jackdaw.
Thank you! Using keywords will do it for now until the option not to mangle names gets released. I tried here and it worked with local Confluent Platform install. I had some problems with Confluent Cloud, but I'll open another issue.
from jackdaw.
Related Issues (20)
- Is `aleph` really needed under the top-level dependencies? HOT 2
- Topology needs to be configured with string keys, which is different from other entities
- Deserializer-properties are not propagated in delegating calls for serde creation HOT 1
- Can't install dependencies HOT 3
- Type checks in jackdaw.client namespace should check for the interface and not the concrete classes
- Update aleph HOT 2
- Update Jackdaw to work with newer versions of kafka-streams / kafka-streams-test-utils HOT 3
- Fix Jackdaw Client API documentation to use poll instead of log HOT 1
- Help understanding how to use Avro references with Jackdaw HOT 1
- 0.9.0 release did not work HOT 2
- Integer-valued configuration keys give errors without explicit casts
- lots of reflection warnings
- Recursively defined Avro records trigger stack overflow
- confluent and kafka version mismatch
- Versions 0.9.x are broken HOT 1
- Avro schemas with union types with int declared before float encode all floats to ints
- Run consumer in thread throw error KafkaConsumer is not safe for multi-threaded access
- Update versions to 7.x and 3.x
- support foreign key joins HOT 1
- jackdaw.admin#retry-exists? error 'call to static method sleep on java.lang.Thread can't be resolved'
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jackdaw.