Skip to content
This repository has been archived by the owner on Mar 12, 2024. It is now read-only.

Investigate why script doesn't output files #28

Closed
flowirtz opened this issue May 29, 2020 · 2 comments
Closed

Investigate why script doesn't output files #28

flowirtz opened this issue May 29, 2020 · 2 comments
Assignees
Labels
bug Something isn't working

Comments

@flowirtz
Copy link
Contributor

flowirtz commented May 29, 2020

We get interesting file structures like the following one:

ocf-uk-metoffice-nwp/MOGREPS-UK/wind_from_direction/2020/m05/d20/h08/MOGREPS-UK__wind_from_direction__2020-05-20T08__2020-05-22T06.zarr

I'd assume that the d20/h08 stands for day 20, hour 8 - why are there files from May 22nd in there then?

Also, so far the only subfolders are for 2020/m05/d20/h08, does that mean no other files are being saved anymore? Did it crash somewhere?

Bucket Filesize as of May 29th: 122.2MB
Bucket Filesize as of May 30th: 122.2MB

-> Something is wrong with the deployment - the script works locally, but deployed it doesn't output files.

Update. After some investigation it turns out that there is an IAM permissions issue. The script is not able to open files from the external MetOffice bucket.

Update 2. Added read/write permission to external MetOffice S3 via 38552aa

@flowirtz flowirtz self-assigned this May 31, 2020
@flowirtz flowirtz changed the title Investigate File Output Investigate why script doesn't output files May 31, 2020
@flowirtz flowirtz added the bug Something isn't working label May 31, 2020
@flowirtz
Copy link
Contributor Author

Latest filesize of bucket is 123.7MB total, as of May 31st, 6pm GMT

@flowirtz
Copy link
Contributor Author

It works now!!! 😍

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant