Confluent Schema Registry with Basic Authentication about abris

[haribabubonthu]

I am able to build for 2.11 and i have added it to databricks.

I am passing below map values

val schemaRegistryConfig1 = Map(
SchemaManager.PARAM_SCHEMA_REGISTRY_URL -> "https://srurl",
SchemaManager.PARAM_SCHEMA_REGISTRY_TOPIC -> "bw-connect.admin.VBPA4.AVRO",
SchemaManager.PARAM_KEY_SCHEMA_NAMING_STRATEGY -> SchemaManager.SchemaStorageNamingStrategies.TOPIC_NAME,
SchemaManager.PARAM_KEY_SCHEMA_ID -> "latest",
"client.basic.auth.credentials.source" -> "USER_INFO",
"client.schema.registry.basic.auth.user.info" -> "srkey:srvalue",
"specific.avro.reader" -> "true"
)

I am able to read deserialized data. Thanks for looking into the issue. Please merge with master branch.

[felipemmelo]

Version 3.1.0 now available at Maven Central.

[xavtx1]

same problem here

[felipemmelo]

Hi guys, sorry for the late reply, I've been OOO this week. Will get into this issue by the beginning of next week.

Cheers.

[felipemmelo]

Hi @haribabubonthu and @xavtx1 ,

I've just updated Schema Manager to receive all configurations provided. The branch is this. The bit that was changed is here.

Could you please have a look if it solves your problem? If it does, we'll merge it to master and deploy to Maven Central.

Thanks in advance.

[haribabubonthu]

Hi @felipemmelo I am trying to create schemaRegistryConfig with below configurations and i am getting below error
val schemaRegistryConfig = Map(
SchemaManager.PARAM_SCHEMA_REGISTRY_URL -> "https://schema-registry-url",
SchemaManager.PARAM_SCHEMA_REGISTRY_TOPIC -> "test.topic"
)

java.lang.NoClassDefFoundError: Could not initialize class za.co.absa.abris.avro.read.confluent.SchemaManager$

1. Can you please provide jar of latest code for scala 2.11
2. what is the SchemaManager configuration for below paramters
   basic.auth.credentials.source
   schema.registry.basic.auth.user.info

[xavtx1]

Hi @haribabubonthu if you can share an example of the code you are currently employed, it would be very useful

[haribabubonthu]

Hi @felipemmelo Is it possible to provide jar for scala 2.11 target??
I am getting errors while making it as package in maven

[haribabubonthu]

Hi @xavtx1

1. In Databricks first add abris dependency jar

2. Then import za.co.absa.abris.avro.read.confluent.SchemaManager

3. val schemaRegistryConfig = Map(
   SchemaManager.PARAM_SCHEMA_REGISTRY_URL -> "sr_url",
   SchemaManager.PARAM_SCHEMA_REGISTRY_TOPIC -> "test.topic"
   )

At this point i am getting error. So i am requesting @felipemmelo to provide jar

[cerveada]

Hello, this could help you to build for 2.11
https://github.com/AbsaOSS/ABRiS/wiki/How-to-cross-compile-Abris

[felipemmelo]

Thanks for confirming @haribabubonthu .

[xavtx1]

I have also been able to deserialize at least locally, without any problem.
Please you can merge to master and publish the artifact.
Then I will try to do the test from Databricks. At the moment, trying to generate a fat jar, using the same code in Databricks has given authentication error.

[felipemmelo]

Hi @xavtx1 and @haribabubonthu , sorry for the late reply, will do it by the end of the day.