As per @jhrozek's suggestion we can use the action configuration to tell which paths we are interested in cloning and thus optimise the cloning part.