Make sure that each subsystem only starts and stop once. This makes sure we don't close e.g. quit channels twice.