[question][hope-reply]: why here we use Java to implement spark-connector as for supporting spark datasourceV2 about spark-bigquery-connector

[littleDrew]

@davidrabinowitz hello, could help to explain it, thanks very much~

[davidrabinowitz]

Several reasons:

• DSv1 is Scala based, DSv2 is Java based
• Using Java let us reuse some of the code to other BigQuery connectors, such as the Hive-BigQuery connector
• The binary incompatibility between different Scala versions caused some issues for users, and it is very difficult to catch that and give proper error message. This has affected mostly first time users whose immediate reaction was "the connector is broken".
• While Scala is an amazing language, the updates of Java 8 brought it closer (lambdas and streams for example) so we don't sacrifice much

[littleDrew]

thanks for your reply~