Allow tests to run with minimal requirements

Before we run tests, we currently install everything in test-requirements.txt. However, not all requirements listed in there are necessary for the driver to function properly. It is easy to make a code change that assumes a non-essential package is installed, so we should default to only installing optional dependencies when using optional packages.