Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

spark-cassandra-connector 1.4.0-M1 not working with spark 1.4.0

Description

I am trying to run below code with spark 1.4.0 and its not working

build file :

Console Log :

The same code is working with spark 1.3.1

Environment

Scalla - 2.11.6
Spark - 1.4.0
spark-cassandra-connector - 1.4.0-M1

Pull Requests

None

Activity

Show:

Piotr Kołaczkowski July 29, 2015 at 12:21 PM

Probably a duplicate of SPARKC-208.

Piotr Kołaczkowski July 29, 2015 at 12:20 PM

This was quite likely caused byt the cassandra.input.split.size_in_mb being misinterpreted as bytes, defaulting to 64 bytes, which produced crazy small splits.
Just published 1.4.0-M2 with this bug fixed.

Stefano Ortolani July 29, 2015 at 10:55 AM
Edited

I can confirm that b1.4 (1.4.0-M2-SNAPSHOT) works.

Stefano Ortolani July 29, 2015 at 10:42 AM

I am on it. Are you on IRC by any chance?

Piotr Kołaczkowski July 29, 2015 at 10:40 AM
Edited

Can you try with b1.4 head? There shouldn't be much difference between b1.4 head and master now.

Duplicate

Details

Assignee

Reporter

Fix versions

Components

Affects versions

Priority

Created July 9, 2015 at 12:47 PM
Updated July 29, 2015 at 3:52 PM
Resolved July 29, 2015 at 12:21 PM