CassandraInJoin doesn't tolerate having upper case in cassandra column names

Description

Trying to read a table by filtering with IN clause may fail if

  • The filtering column name has uppercase letters

  • The collection of values is bigger than spark.cassandra.sql.inClauseToJoinConversionThreshold (So CassandraInJoin is used)

 

You can reproduce it with:

 

This gives the following error

Environment

spark 3.1.1

spark-cassandra-connector 3.0.1 (or 3.1.0)

Pull Requests

None

Activity

Show:

Details

Assignee

Reporter

Components

Affects versions

Priority

Created April 5, 2022 at 10:26 AM
Updated May 26, 2022 at 1:25 PM