Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Remove dependency on describe_ring thrift call

Description

Now that we have Java driver 2.1.5 with TokenRange metadata support released, we can start removing thrift dependency.

Pull Requests

None

Activity

Show:

Piotr Kołaczkowski March 31, 2015 at 1:34 PM

I tested on a local 3-node cluster:

scala> sc.cassandraTable("test", "kv").getPartitions.foreach(println) CassandraPartition(0,Set(/192.168.123.11, /192.168.123.10),Vector(CqlTokenRange(token("key") > ?,WrappedArray(3074457345618258602))),127) CassandraPartition(1,Set(/192.168.123.12, /192.168.123.10),Vector(CqlTokenRange(token("key") > ? AND token("key") <= ?,WrappedArray(-3074457345618258603, 3074457345618258602))),127) CassandraPartition(2,Set(/192.168.123.11, /192.168.123.12),Vector(CqlTokenRange(token("key") <= ?,WrappedArray(-3074457345618258603))),127) scala> sc.cassandraTable("test", "kv").collect().foreach(println) CassandraRow{key: 9, value: v9} CassandraRow{key: 14, value: v14} CassandraRow{key: 12, value: v12} CassandraRow{key: 3, value: v3} CassandraRow{key: 4, value: v4} CassandraRow{key: 15, value: v15} CassandraRow{key: 7, value: v7} CassandraRow{key: 6, value: v6} CassandraRow{key: 5, value: v5} CassandraRow{key: 10, value: v10} CassandraRow{key: 13, value: v13} CassandraRow{key: 11, value: v11} CassandraRow{key: 1, value: v1} CassandraRow{key: 8, value: v8} CassandraRow{key: 2, value: v2}

Jacek March 27, 2015 at 8:43 PM

- Alex added the ability to run multiple nodes in integration tests.

Piotr Kołaczkowski March 27, 2015 at 7:43 PM
Edited

As for testing: this needs checking the basic RDD functionality on a cluster of size > 1.

Fixed

Details

Assignee

Reporter

Reviewer

Reviewer 2

Pull Request

https://github.com/datastax/spark-cassandra-connector/pull/608
https://github.com/datastax/spark-cassandra-connector/pull/608

Components

Fix versions

Priority

Created March 18, 2015 at 1:12 PM
Updated March 31, 2015 at 1:38 PM
Resolved March 31, 2015 at 1:38 PM

Flag notifications