Asyncore race condition cause logging exception on shutdown
Description
Follow-up PYTHON-1228. It looks like there is a race condition with the previous fix, which result to an exception. We should probably just remove the LogWrapper introduced in 1228 and avoid any logging when we hit this threading issue.