Dependency conflict when using with spark 2.3.x about abris

[cerveada]

Hello, it looks like wrong version of org.apache.avro is in use. Avro 1.8 or higher should be ok. Abris uses 1.8.2. My guess is that in your app it's overwriten to some older version. Could you check that please?

Spark 2.3.0 uses Avro 1.7.7
https://github.com/apache/spark/blob/v2.3.0/pom.xml#L142

This library uses Spark 2.3.0 and also Avro 1.8.2.

[cerveada]

Yes, this is due to dependency on spark-avro 2.4.4 which needs Avro 1.8+.

We are planing to relase a version for Scala 2.12 and spark 2.4.4 soon, but you could also explicitly declare dependency on avro 1.8. in your app and overwrite the one that comes from spark you are including.

However Abris doesn't fail to build for scala. The problem commes from your app using spark 2.3 which in turn overrides the dependency on avor to 2.7.

[cerveada]

New version (3.0.1) was just released, but it takes like six hours to get to maven central.

If you want to use spark 2.4.x try the new version, it should work well. For spark 2.3.x you still need to have a dependency on avro 1.8.

Great, thank you! I will give the new release a try.