Reload overriding configs after boot.
Prior to this change, two configs were allow to change from dashboard, but will not take effect after reboot:
* Logging (such as level)
* Prometheus configs