Remove SCC shutdown hook

Description

SCC uses a shutdown hook to close C* session cache. It caused a lot of problems in the past, e.g. SPARKC-620. The hook should be replaced with a more reliable solution. Adding a close method to SCC api seams like a reasonable thing to do.
Unfortunately Spark DSv2 API doesn't come with a full catalog lifecycle management - it only has initialize method. Up to a discussion.

Pull Requests

None

Assignee

Unassigned

Reporter

Jaroslaw Grabowski

Labels

None

Reviewer

None

Reviewer 2

None

Tester

None

Pull Request

None

Priority

Major
Configure