Script to find/replace objects with suffix \n in a gcs bucket

[raj-prince]

1. Make sure ADC setup.
2. Install the pip dependency google-cloud-storage: pip3 install google-cloud-storage
3. Copy and run the below python script.

from google.cloud import storage

def find_gcs_objects_with_newline_suffix(bucket_name, prefix=None):
    try:
        client = storage.Client()
        bucket = client.bucket(bucket_name)
        objects_with_newline = []

        blobs = bucket.list_blobs(prefix=prefix)
        for blob in blobs:
            if blob.name.endswith('\\n'):
                objects_with_newline.append(f"gs://{bucket_name}/{blob.name}")

        return objects_with_newline

    except Exception as e:
        print(f"An error occurred: {e}")
        return []

if __name__ == "__main__":
    bucket_name = "princer-bkt-with-invalid-object" # Without gs://

    objects = find_gcs_objects_with_newline_suffix(bucket_name)

    if objects:
        print("Objects ending with '\\n':")
        for obj in objects:
            print(obj)
    else:
        print("No objects found ending with '\\n'.")

4. Once you find objects with suffix \n, you can use gcloud storage mv to rename that object. E.g.
   gcloud storage mv "gs://my_bucket/\n" gs://my_bucket/newprefix