Issues
- Support for Apache Spark 4.0SPARKC-716Jaroslaw Grabowski
- Add Spark/Connector 3.3 for Scala 2.13SPARKC-709Jaroslaw Grabowski
- Bump DSE & OSS C* versions to the latest patch/RC versionsSPARKC-657Resolved issue: SPARKC-657Madhavan Sridharan
- SCC 2.5.0 doesn't work on Databricks because of the non-shaded classesSPARKC-601Resolved issue: SPARKC-601Jaroslaw Grabowski
- Missing jars when using --packages with SCC 2.5.0SPARKC-599Resolved issue: SPARKC-599Jaroslaw Grabowski
- branch 2.5 assmbly failedSPARKC-592Resolved issue: SPARKC-592Russell Spitzer
- Make Shaded Spark Cassandra Connector 3.0 BuildSPARKC-576Resolved issue: SPARKC-576Jaroslaw Grabowski
- commons-utils v1.9.3 in spark-cassandra-connector v2.0.12 is vulnerable to CVE-2014-0114SPARKC-569Resolved issue: SPARKC-569Russell Spitzer
- Undeclared dependency on commons-configurationSPARKC-566Resolved issue: SPARKC-566Russell Spitzer
- Hosted API Docs for 2.0.2 are brokenSPARKC-493Resolved issue: SPARKC-493Brian Cantoni
- Jenkins and Travis fail because of timeout on closing ConnectorSPARKC-377Resolved issue: SPARKC-377Jaroslaw Grabowski
- Travis builds fail, JVM exits with 137 codeSPARKC-367Resolved issue: SPARKC-367Jaroslaw Grabowski
- Upgrade Spark to 1.6.1SPARKC-344Resolved issue: SPARKC-344Jacek
- Fix assembly in b1.5 and MasterSPARKC-311Resolved issue: SPARKC-311Jacek
- Update master to use Spark 1.6.0 finalSPARKC-305Resolved issue: SPARKC-305Jacek
- Upgrade to Cassandra Driver 3.0.0-beta1SPARKC-302Resolved issue: SPARKC-302Jacek
- Update master to use Spark 1.6.0-rc2 and Cassandra Driver 3.0.0-beta1SPARKC-298Resolved issue: SPARKC-298Jacek
- Update master to use Spark 1.6.0-rc1SPARKC-297Resolved issue: SPARKC-297Jacek
- Sbt assembly brokenSPARKC-296Resolved issue: SPARKC-296Eric Meisel
- sbt -Dscala-2.11=true assembly fails due to impossible to get artifacts - IvyNode = org.slf4j#slf4j-log4j12;1.7.6SPARKC-295Resolved issue: SPARKC-295Russell Spitzer
- mention java-driver 3.0 in readme. remove project/CassandraSparkBuild.scala.origSPARKC-286Resolved issue: SPARKC-286Artem Aliev
- Explain/fix hanging Cassandra during integration testsSPARKC-246Resolved issue: SPARKC-246Jacek
- Fix SBT build so that it does not need to compile project on import to IDEASPARKC-243Resolved issue: SPARKC-243Jacek
- Allow for building against unreleased Spark versionsSPARKC-242Resolved issue: SPARKC-242Jacek
- Integrate with Spark 1.5.0SPARKC-241Resolved issue: SPARKC-241Jacek
- Fix travisSPARKC-239Resolved issue: SPARKC-239Brian Cantoni
- Spark Master HA sometimes causes Spark Master to start on a different port and then dse spark-submit doesn't work properlySPARKC-175Resolved issue: SPARKC-175H
27 of 27
Support for Apache Spark 4.0
Description
Pull Requests
None
Created September 16, 2024 at 1:37 PM
Updated September 16, 2024 at 1:40 PM
Activity
Show:
Jack BugginsSeptember 16, 2024 at 1:40 PM
I don’t have a great deal of bandwidth currently, hard to say exactly when that changes, but if nobody volunteers prior I may be able to pick this up in the future.
As spark is in voting stages for v4.0, we can begin anticipating changes that may be required to the cassandra connector, and implementing them.
The goal of this story is that users can upgrade to the spark cassandra connector with a version at the same level as spark, with the same core dependency versions shortly after the spark 4.0 is published.
Whilst development work can be completed before, finalisation and publishing will depend on spark voting of RC’s to be closed.
I haven’t personally had a huge opportunity to understand the changes yet, any help in identifying major API changes from the community will most certainly be useful to the final community member who is assigned.