Involve related spark kyuubi-extension modules into kyuubi-spark-sql-engine.jar

[turboFei]

For example:
if the profile for building kyuubi is -Pspark-3.1.

How about involving modules kyuubi-extensions-spark-common and kyuubi-extensions-spark-3.1 into kyuubi-spark-sql-engine.jar directly?

It should be more convenient.

Any concern for this?

[yaooqinn]

If you switch SPARK_HOME in runtime, you may fail

[pan3793]

Then the kyuubi-spark-sql-engine.jar becomes a version specific, it can not run across spark 3.0/3.1/3.2

[turboFei]

Thanks, got it.

I can do that for my use case.

For my use case:

1. we maintain single spark version for kyuubi spark engine, so the spark version is bound to kyuubi server.

[yaooqinn]

use spark conf to point to the extension

[turboFei]

thanks, will try to use spark.jars.

[pan3793]

I'm wondering if we can support multi jars when submit engine, it's value for case like mysql jdbc driver, due the license issue, we can not bundle it into engine jar.