Add new exec for old output

[apinkert]

Since GH actions doesn't want to use things like mkdir, we're writing a custom executor using fs and fs-extra instead to get our output matching our old clients.