Below is the DDL for the table created in cassandra
Requirement is to perform delete operation based on the test_id field through Spark SQL. I am following the below steps, I am able to fetch the records and store it in data frame.
But the below DELETE query is throwing an error
Kindly let us know if this is the right approach for deleting records in Cassandra through Spark SQL. And also is there an alternate way to delete records
Pull Requests
None
Activity
Artem Aliev
November 11, 2016 at 10:39 AM
SPARKC-349 will provide delete method for RDD so for DataFrames it will be:
surya thangaraj
June 23, 2016 at 6:22 PM
Can you please provide an example to do this deletion using the spark cassandra connector?
Alex Liu
June 22, 2016 at 4:59 PM
spark sql doesn't support delete command, you can check how connector do the deletion in example tests of CassandraConnectorSpec
Major
Below is the DDL for the table created in cassandra
Requirement is to perform delete operation based on the test_id field through Spark SQL.
I am following the below steps, I am able to fetch the records and store it in data frame.
But the below DELETE query is throwing an error
Kindly let us know if this is the right approach for deleting records in Cassandra through Spark SQL.
And also is there an alternate way to delete records