Clean up `PreserveLoggingContext`.