Leverage Endpoint or BroadcastAddress as opposed to BroadRpcAddress to avoid confusion in the logging

Description

Spark Cassandra Connector (SCC) 2.11_2.5.1 which includes DataStax Java Driver 4.7.2 when leveraged from GCP's Dataproc cluster gives the following warning when executed against a DSE 6.8.3 cluster,

Trying to bump datastax-java-driver.advanced.connection.init-query-timeout property to 60 seconds also did not eliminate this warning message even though this gets the job done without any errors. spark.cassandra.connect.host only contains the private IPs as these jobs are getting executed from the Dataproc clusters which are inside the same VPC as the DSE nodes and hence don't need to make use of the public IPs at all.

Configuration on the cassandra.yaml is as follows,

  • listen_address: "<private_ip>"

  • listen_interface is commented out (default)

  • broadcast_address is commented out (default)

  • native_transport_address: "<private_ip>"

  • native_transport_interface is commented out (default)

  • native_transport_broadcast_address: "<public_ip>"

This https://github.com/datastax/java-driver/blob/4.7.2/core/src/main/java/com/datastax/oss/driver/internal/core/pool/ChannelPool.java#L337 come up from the SCC. So the headache this was causing was that the SCC was throwing a warning about a problem opening a channel, and, everything is working, but the warning was coming from the public IP address, which in this case is set as the broadcast_native_transport_address. It was not making sense why the setting for native_transport_address was still showing the value of native_transport_broadcast_address.

We determined where the address fields for the driver get loaded from. This ticket is to have the logger print the Endpoint or BroadcastAddress here instead of BroadcastRpcAddress to avoid confusion between the public and private addresses, for ring operators/admins?

Also, what is not so clear is that even after the successful connection to the cluster, why would we end up getting this channel opening error/warning.

Environment

None

Pull Requests

None

Assignee

Unassigned

Reporter

Madhavan Sridharan

Labels

None

PM Priority

None

Affects versions

Fix versions

None

Pull Request

None

Doc Impact

None

Size

None

External issue ID

None

External issue ID

None

Components

Priority

Major
Configure