Cannot use BatchQuery save methods when using ResponseFuture ?

2. Indeed, you cannot execute statements inside a query callback. I think this is the issue you are experiencing. You cannot execute statements in the handle_page function.

3. The problem is in your application code. You shouldn´t have to modify that value. Make you you don´t execute statements inside callbacks.

Ok, I'm sure that's the issue: I'm executing queries inside a query callback.
Thanks!

Given that, how could I perform the task? Do you have any idea? resources which I can check?

I need to iterate through fetched results and update rows and the only thing that worked for me to iterate efficiently through millions of records was the async/ResponseFuture pattern.

The important thing is to not call execute/execute_async in the callback, which is executed inside the event loop. So you could simply iterate the results and send them to another consumer (with a Queue in example).

Thanks for details.

Indeed, that batch script was coded using Kafka...I wanted to avoid it for batch processing but I had wrong assumptions
I will try with a simple Python Queue as you suggested.

Cheers!

d.

Great. Good luck!