Can't connect to cassandra with SCC 2.5+ on Databricks: TypeSafeConfig

Description

Trying to follow the quick start guide, but keep getting the following error:

Reproducing:

Full log:

While:

gives:

SSC 2.5+ allow configuration to be set by using a java driver profile. But when I try that, I keep getting the same error as above.

Reproducing:

Full log:

Environment

Databricks Cluster with Runtime 7.5

  • Apache Spark 3.0.1

  • SCC Maven coordinator: com.datastax.spark:spark-cassandra-connector_2.12:3.0.0

  • Python 3.x

  • Scala 2.12
    Instaclustr's Cassandra (cql_version='3.4.4')) or Amazon Keyspaces (cql_version='3.4.4')

Pull Requests

None

Activity

Show:

Jaroslaw Grabowski January 18, 2021 at 1:11 PM

When specifying a config profile file you may use globally accessible URLs or file names provided with --files options (docs). Here is an example with --files:

Contact points should be provided as host:port pairs (docs), here is a sample application.conf:

Note the datacenter property which is mandatory when explicitly specifying contact-points. Daemon property ensures that cached sessions won’t stop your app from exiting.

Unless you’re doing some serious reconfiguration in application.conf then it’s recommended to use standard SCC properties (docs).

Igor Gustavo Hoelscher January 15, 2021 at 6:22 PM

Thank you! It worked for me.

But I still cannot use a Java Driver profile:

 

It seems to ignore the contact-points configured under this profile (and probably everything else). I must be doing something wrong and this could be the wrong channel to ask for help, so could you point me where can I get help with this?

Thank you, again!

Jaroslaw Grabowski January 15, 2021 at 4:52 PM

Not a Problem

Details

Assignee

Reporter

Components

Affects versions

Priority

Created January 15, 2021 at 4:08 PM
Updated January 18, 2021 at 1:12 PM
Resolved January 18, 2021 at 1:12 PM