Most likely when it is enabled we need to apply distinct to union of both subset before we pass them to the later processing. Otherwise in certain situations delta itself pickups the same records as retry and we end up with duplicates.