spark-sql session doesn't exit cleanly

Description

I was playing with SCC & Spark 3.0.1, and noticed that I can't finish my work clearly - the Spark session just hangs with following errors, and even Ctrl-C doesn't help:

spark-sql was started with following command

Environment

Spark 3.0.1
SCC 3.0.0-beta
MacOS 10.12
Cassandra 4.0-beta2

Pull Requests

None

Activity

Show:
Jaroslaw Grabowski
September 15, 2020, 11:21 AM

This happens also for Spark 3.0.0. Only spark-sql is affected, spark-shell works fine for both versions.

Jaroslaw Grabowski
September 17, 2020, 10:25 AM

Workaround:

set spark.cassandra.connection.keepAliveMS to 0

Jaroslaw Grabowski
September 17, 2020, 8:47 PM

Apparently hive closes the class loader responsible for loading these classes.

Assignee

Jaroslaw Grabowski

Reporter

Alex Ott

Fix versions

Labels

None

Reviewer

None

Reviewer 2

None

Pull Request

None

Components

Affects versions

Priority

Major
Configure