You don't have to, but you could run into issues because when a kernel is updated its modules are unloaded. So, for example, you won't be able to load external drives until you reboot or manually load the needed module.