Fix that obsoleted cert file will not be deleted after the listener is updated/deleted