This will prevent crashes when Buildbot tries to execute dynamically
added steps.