Add Compression Support

Description

Creating this ticket to add compression support ( lz4 & snappy ) for communication between driver and C*

Environment

None

Pull Requests

None

Activity

Show:
Jorge Bay Gondra
April 20, 2018, 10:00 AM

+1 this is long overdue.

I've been avoiding this as compression on a single core will block any other activity in Node.js, so it's unlikely that a user will want that behaviour in the driver.

Jorge Bay Gondra
June 29, 2018, 11:32 AM
Edited

Unlike zlib which uses a the libuv threadpool for compressing/decompressing, there is no lz4 / snappy that uses the threadpool... So I don't see a way to properly implement it.

Another solution would be to try out the experimental worker threads api and if queuing work to other threads could help...

EDIT 2019-10-01:
worker threads are no longer experimental in Node.js 12+

Jorge Bay Gondra
October 7, 2019, 3:12 PM

I’ve detached compression support (this ticket) from threading optimizations for compression (NODEJS-567)

 

Assignee

Unassigned

Reporter

Chris Splinter

Reviewer

None

Fix versions

None

Labels

None

Components

None

PM Priority

C

Pull Request

None

Priority

Major
Configure