Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PR for dask support to ARIAtools - WIP #379

Draft
wants to merge 56 commits into
base: dev
Choose a base branch
from
Draft

PR for dask support to ARIAtools - WIP #379

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
56 commits
Select commit Hold shift + click to select a range
a0591fd
add dask support, modified extractPorduct to support dem/mask str input
mgovorcin Aug 17, 2023
7684d07
fix wrong change in finalize_metadata
mgovorcin Aug 17, 2023
3e518d4
add perp_mask import
mgovorcin Aug 17, 2023
462203c
workaround solution for imaging geometry
mgovorcin Aug 17, 2023
4bd35aa
add link to dask issues
mgovorcin Aug 17, 2023
0b9617f
fix typo
mgovorcin Aug 17, 2023
00b4581
add_option_to_mask_zero_component
mgovorcin Aug 22, 2023
d0c15a1
Merge branch 'dev' into dask_parallelize
Aug 24, 2023
38bf567
fix typos
Aug 29, 2023
f5d335a
extract tropo layers using dask
bbuzz31 Sep 1, 2023
285dab3
remove old tropo dask function
bbuzz31 Sep 1, 2023
0b9d54f
Merge branch 'dev' into dask_parallelize
bbuzz31 Sep 1, 2023
90e5a96
Merge branch 'dask_parallelize' of github.com:aria-tools/ARIA-tools i…
Sep 1, 2023
b820ea3
fix syntax
bbuzz31 Sep 1, 2023
f005d44
Merge branch 'dask_parallelize' of github.com:aria-tools/ARIA-tools i…
Sep 1, 2023
ad61139
add iono_dask support
Sep 3, 2023
d785040
added TODO note
Sep 3, 2023
38f0d93
Merge branch 'dask_parallelize' of github.com:aria-tools/ARIA-tools i…
Sep 5, 2023
d31a319
typo fix
Sep 5, 2023
c26f888
Merge branch 'dev' into dask_parallelize
Sep 6, 2023
4840963
Merge branch 'dev' into dask_parallelize
bbuzz31 Sep 6, 2023
6ebadf9
finalize tropo dask extraction
bbuzz31 Sep 7, 2023
0e054ea
Merge branch 'dask_parallelize' of github.com:aria-tools/ARIA-tools i…
Sep 7, 2023
ec7107f
for tropo, skip gunws without tropo layer
Sep 7, 2023
59058a5
breath, messages
bbuzz31 Sep 7, 2023
5fdaa2c
typo
bbuzz31 Sep 7, 2023
e0398ec
typo2
bbuzz31 Sep 7, 2023
3f305f3
bugfix
bbuzz31 Sep 7, 2023
95cc5b0
Update env for dask requirements
sssangha Sep 8, 2023
a04eedd
Fix typo in function
sssangha Sep 8, 2023
aa2e1b0
Remove nonexistent function reference
sssangha Sep 8, 2023
7ce9e94
Remove hack that leads to crash
sssangha Sep 13, 2023
efad147
Mask definition bug
sssangha Sep 14, 2023
ef53017
Fix typo in iono code
sssangha Sep 15, 2023
537bea6
Fix bugs in stack generation of notebook
sssangha Sep 15, 2023
50abb1e
set nodata value so mintpy goes
Sep 16, 2023
066269e
Merge branch 'dask_parallelize' of github.com:aria-tools/ARIA-tools i…
Sep 16, 2023
91fc7bb
fixes for stitcher and exportProduct
mgovorcin Sep 25, 2023
91924ac
option to import bperp from txt file
mgovorcin Sep 30, 2023
4674ce0
shift zero component per frame
mgovorcin Nov 4, 2023
1157214
update contrib with dask processing
mgovorcin Dec 12, 2023
3a0b13f
add author
mgovorcin Dec 13, 2023
6566280
skip nc files that cannot be read
mgovorcin Dec 18, 2023
48a3b34
missing: add loading itertools module
mgovorcin Dec 18, 2023
e062011
add white space at the end
mgovorcin Dec 18, 2023
c0e2575
Add warning message if there are no gunws in directory
mgovorcin Dec 19, 2023
c84913f
add note about parallel processing bug
mgovorcin Dec 19, 2023
d44a18f
add function for check-ups and clean-up
mgovorcin Dec 23, 2023
17a133d
update prep_mintpy
mgovorcin Dec 23, 2023
56c7a64
minor fixes
mgovorcin Dec 29, 2023
dc02b90
add check on the existing gunw dir vs df gunw dir
mgovorcin Dec 29, 2023
1b50180
add additional scripts for Mintpy inspection
mgovorcin Dec 29, 2023
6b4e522
add warning message if AOI json file exists
mgovorcin Dec 29, 2023
aecc63c
add message to exist json warning
mgovorcin Dec 29, 2023
f8c856f
added comment for dir cleaning
mgovorcin Dec 29, 2023
504c7d6
update get_stack_ix
mgovorcin Dec 29, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
2 changes: 2 additions & 0 deletions environment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@ dependencies:
- asf_search
- cartopy
- dem_stitcher>=2.5.0
- dask
- distributed
- gdal>=3.4.1
- h5py
- joblib
Expand Down
2 changes: 2 additions & 0 deletions requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,8 @@ python>=3.8
asf_search
cartopy
dem_stitcher>=2.5.0
dask
distributed
gdal>=3.4.1
h5py
joblib
Expand Down
2 changes: 1 addition & 1 deletion tools/ARIAtools.egg-info/SOURCES.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ tools/ARIAtools/productPlot.py
tools/ARIAtools/progBar.py
tools/ARIAtools/sequential_stitching.py
tools/ARIAtools/shapefile_util.py
tools/ARIAtools/stitiching_util.py
tools/ARIAtools/stitching_util.py
tools/ARIAtools/tsSetup.py
tools/ARIAtools/unwrapStitching.py
tools/ARIAtools/url_manager.py
Expand Down
2 changes: 1 addition & 1 deletion tools/ARIAtools/ARIAProduct.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -796,4 +796,4 @@ def __run__(self):
'continuous interferograms.')
self.products = self.__continuous_time__()

return self.products
return self.products