Esmlab Design Document

[andersy005]

HackMD note: https://hackmd.io/mwGPvXgXSu2f7iXGCO3m4A?edit

[dcherian]

I saw mention of indices here, so wanted to make sure you were aware of https://github.com/Ouranosinc/xclim

[matt-long]

cc @maboualidev, @kmpaul

[bradyrx]

I can't edit that document directly, but wanted to make you aware of https://github.com/bradyrx/esmtools/ as well. I don't think these clash, since esmtools is really a repository for personal functions I use commonly with working with gridded output. It's a kitchen sink for really any sort of domain-specific or domain-agnostic functions for climate analysis.

There might be some things in there worth migrating or drawing from. Particularly functions related to our discussion in bradyrx/esmtools#65. Between climpred and esmtools stats modules I have an rm_poly, rm_trend, fit_poly (returns the actual fit that was made), ACF, autocorr, corr and so on that can be applied to a grid. The native scipy and numpy functions can't of course just ingest gridded products. I have code snippets to update the functions to be optimized for dask per work with @andersy005 and @gelsworth

[andersy005]

@bradyrx,

I can't edit that document directly,

Let me know whether https://hackmd.io/mwGPvXgXSu2f7iXGCO3m4A?edit doesn't work when you are signed in (I will fix this).

[andersy005]

@maboualidev, @matt-long

I just updated the design document with some of information from our discussion this afternoon. When you get a chance in the coming days, please take a look at it, and add the bits that are missing.

[andersy005]

Cc @dougiesquire

[huard]

@andersy005

Hi, xclim dev here. I've gone through the list of issues in esmlab and it looks like we're sharing many objectives. In particular, I'd like to see weighted statistics supported natively by xarray, as well as support for time_bnds aware operations.

Originally, xclim was designed to be a library of climate indicators that are typically used for climate impact studies. We've added some utilities around it, but there's clearly a lot of overlap with other packages. We'd be happy for xclim to focus on climate indicators, include ocean and ice indicators, and outsource other utilities (ensemble stats, clustering, subsetting) to other libraries such as esmlab.

Would it be useful to have an Earth System Modeling and Data Analysis project board somewhere (e.g. pydata) to coordinate efforts?

[maboualidev]

Looks good to me. I just changed the link to https://github.com/coderepocenter/AxisUtilities regards, Moe

…

On Wed, Oct 30, 2019 at 11:47 PM Anderson Banihirwe < ***@***.***> wrote: @maboualidev <https://github.com/maboualidev>, @matt-long <https://github.com/matt-long> I just updated the design document with *some* of information from our discussion this afternoon. When you get a chance in the coming days, please take a look at it, and add the bits that are missing. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#148?email_source=notifications&email_token=AF5OIB3VMBXBBYSGRRY25CLQRJWQ7A5CNFSM4IW2RVNKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOECWUG5Y#issuecomment-548225911>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AF5OIB2GVUGA6H7RKJIFDUDQRJWQ7ANCNFSM4IW2RVNA> .

-- M. Abouali, Ph.D Data Scientist, Global Data Insight & Analytics (GDI&A) Ford Motor Company Cell: 619-550-6674 ===================================================== De informatie opgenomen in dit bericht kan vertrouwelijk zijn en is uitsluitend bestemd voor de geadresseerde. Indien u dit bericht onterecht ontvangt wordt u verzocht de inhoud niet te gebruiken en de afzender direct te informeren. ===================================================== The information contained in this message may be confidential and is intended to be exclusively for the addressee. Should you receive this message unrightfully, please do not use the contents herein and notify the sender immediately by return e-mail. =====================================================