cannot access data for some dates

[mazingaro]

Hi,

The script for getting data from 1. April 2017 to the 1. November 2017 downloads me only data for October and a few Septembers.
This is the code I'm running:
python Sentinel_download.py -s S2 -m 50 --latmin 46.3 --latmax 46.7 --lonmin 13.8 --lonmax 14.1 -a apihub.txt -d 20170401 -f 20171101 -w /home/alen/Downloads/sentinel2

When trying to get just data from April to May, there is an error.
I run:
python Sentinel_download.py -s S2 -m 50 --latmin 46.3 --latmax 46.7 --lonmin 13.8 --lonmax 14.1 -a apihub.txt -d 20170401 -f 20170501 -w /home/alen/Downloads/sentinel2
And I get:
`wget --no-check-certificate --user="XXX" --password="XXX" --output-document=query_results.xml "https://scihub.copernicus.eu/apihub/search?q=footprint:\"Intersects(POLYGON((13.8 46.3, 14.1 46.3, 14.1 46.7, 13.8 46.7,13.8 46.3)))" filename:S2* producttype:S2MSI1C &rows=100"
--2018-02-01 15:23:42-- https://scihub.copernicus.eu/apihub/search?q=footprint:%22Intersects(POLYGON((13.8%2046.3,%2014.1%2046.3,%2014.1%2046.7,%2013.8%2046.7,13.8%2046.3)))%22%20filename:S2*%20producttype:S2MSI1C%20&rows=100
Resolving scihub.copernicus.eu (scihub.copernicus.eu)... 131.176.236.28
Connecting to scihub.copernicus.eu (scihub.copernicus.eu)|131.176.236.28|:443... connected.
HTTP request sent, awaiting response... 401 Unauthorized
Authentication selected: Basic realm="Sentinels Scientific Data Hub Search"
Reusing existing connection to scihub.copernicus.eu:443.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [application/xml]
Saving to: ‘query_results.xml’

query_results.xml [ <=> ] 288,43K --.-KB/s in 0,1s

2018-02-01 15:23:47 (2,78 MB/s) - ‘query_results.xml’ saved [295353]
`

I am running the code in Linux Mint 18.3. I tried to do it also without -w.
The listing -n from 1.4.2017 to 1.11.2017 stop with the dataset from the 28.9.2017.

What's going on, could somebody help me please? :)

[olivierhagolle]

Hi Alen,
this issue is due to the maximum number of records provided by copernicus hub, which is 100 by default.
if you add -r 300, you will have access to some of the files you need.
Your polygon is quite large, you should split it in chunks !

The issue is that the interface of Copernicus hub, when I wrote this code, did not allow to query on the acquisition date, only the ingestion date, which is not very interesting. . So the tool gets all the records first and then selects the dates in the specified range. If the number of records is not high enough, you do not get the data sets. Maybe ESA added the possibility to query on the date more recently, I did not check.

[mazingaro]

Hi @olivierhagolle,

I redefined the area and added -r 300 and it works.

Thanks for your reply!