Details
Assignee
UnassignedUnassignedReporter
Jaroslaw GrabowskiJaroslaw GrabowskiAffects versions
Priority
Major
Details
Details
Assignee
Unassigned
UnassignedReporter
Jaroslaw Grabowski
Jaroslaw GrabowskiAffects versions
Priority
Created April 25, 2022 at 12:07 PM
Updated April 25, 2022 at 12:07 PM
3.0.0 introduced a regression, "spark.cassandra.table.size.in.bytes" parameter is ignored. There is no way to override the estimated size of the table. This results in limited control over the number of partitions generated by
PartitionGenerator
.A workaround is to override
spark.default.parallelism