Second fix to directory owners

Only change owners of the needed directories

Looks like when the whole /github directory owner is changed, then the
next job in the pipeline fails because of the wrong permissions.