Solr_query Virtual Column Should be Ignored

Description

Solr_query is a virtual column added by Datastax Search. When writing to a table which has this virtual column SCC will complain that such a column does not exist. To make it easier to work with these tables we should eliminate these columns from write and reading mappers.

Environment

None

Pull Requests

https://github.com/datastax/spark-cassandra-connector/pull/1184 - 1.6 https://github.com/datastax/spark-cassandra-connector/pull/1188 - 2.0 https://github.com/datastax/spark-cassandra-connector/pull/1189 - 2.3 https://github.com/datastax/spark-cassandra-connector/pull/1190 - master

Activity

Russell Spitzer 
June 13, 2019 at 1:26 PM

Could you write a reproducible code sample?

Gaurav Kohli 
June 13, 2019 at 5:23 AM
(edited)

Should this be implemented while reading data from cassandra as well? Here's a use-case

1. read from cassandra table that contains virtual col
2. remove one column and join with another dataset containing same column (to bring back the column)
2. write back to same cassandra table in append mode

produces

Fixed

Details

Assignee

Reporter

Fix versions

Affects versions

Priority

Created June 8, 2018 at 7:16 PM
Updated June 13, 2019 at 1:26 PM
Resolved July 9, 2018 at 3:53 PM