Orbit file timeout (March 2021)

Hello

We can download manually the orbit data from https://scihub.copernicus.eu/gnss/, however we are experiencing problems with sentinel 1 orbits files automatic download.

We are processing in near real time, so we ask por AUX_RESORB files (‘Sentinel Restituted (Auto Download)’) when calling Apply-Orbit-File gpt operator. The automatic download is unsuccessful, please see one example of the output of the operator is:

b"INFO: org.esa.snap.python.gpf.PyOperatorSpi: Python operator ‘py_sambuca_snap_op’ registered (Python module: ‘sambuca_snap_op’, class: ‘sambuca_snap_op’, root: ‘/home/seasnet/.snap/system/modules/org-esa-sen2coral-sen2coral-inversion.jar’)\nINFO: org.esa.snap.core.gpf.operators.tooladapter.ToolAdapterIO: Initializing external tool adapters\nINFO: org.esa.s2tbx.dataio.gdal.GDALVersion: GDAL 3.0.4 found on system. JNI driver will be used.\nINFO: org.esa.s2tbx.dataio.gdal.GDALVersion: Installed GDAL 3.0.4 set to be used by SNAP.\nINFO: org.esa.snap.core.util.EngineVersionCheckActivator: Please check regularly for new updates for the best SNAP experience.\nINFO: org.esa.s2tbx.dataio.gdal.GDALVersion: Installed GDAL 3.0.4 set to be used by SNAP.\nINFO: org.hsqldb.persist.Logger: dataFileCache open start\nWARNING: org.esa.s1tbx.sar.gpf.orbits.ApplyOrbitFileOp: No valid orbit file found for 30-APR-2021 19:04:05.000000\nOrbit files may be downloaded from https://qc.sentinel1.eo.esa.int/ or http://aux.sentinel1.eo.esa.int/\nand placed in /home/seasnet/.snap/auxdata/Orbits/Sentinel-1/RESORB/S1A/2021/04\n\nError: [NodeId: someNodeId] No valid orbit file found for 30-APR-2021 19:04:05.000000\nOrbit files may be downloaded from https://qc.sentinel1.eo.esa.int/ or http://aux.sentinel1.eo.esa.int/\nand placed in /home/seasnet/.snap/auxdata/Orbits/Sentinel-1/RESORB/S1A/2021/04\n"
b’Executing processing graph\nOpenSearch: https://scihub.copernicus.eu/gnss/search?q=platformname:Sentinel-1 AND platformnumber:A AND producttype:AUX_POEORB AND beginposition:[2021-04-01T00:00:000Z TO 2021-04-31T24:00:000Z]\nOpenSearch: 11 total results on 1 pages.\nOpenSearch: https://scihub.copernicus.eu/gnss/search?q=platformname:Sentinel-1 AND platformnumber:A AND producttype:AUX_POEORB AND beginposition:[2021-04-01T00:00:000Z TO 2021-04-31T24:00:000Z]\nOpenSearch: https://scihub.copernicus.eu/gnss/search?q=platformname:Sentinel-1 AND platformnumber:A AND producttype:AUX_POEORB AND beginposition:[2021-05-01T00:00:000Z TO 2021-05-31T24:00:000Z]\nOpenSearch: 0 total results on 1 pages.\nNo valid orbit file found for 30-APR-2021 19:04:05.000000\nOrbit files may be downloaded from https://qc.sentinel1.eo.esa.int/ or http://aux.sentinel1.eo.esa.int/\nand placed in /home/seasnet/.snap/auxdata/Orbits/Sentinel-1/RESORB/S1A/2021/04\n done.\n’

Although the Restituted are requested, it seems that it is looking for Precise

We were able of download for few days the data using the sentinelsat python module (we use this module to download Sentinel 1 and 2 data). However last week, the orbit file download started to fail. The sentinelsat query, get the desired set of products sentinel 1 orbit files, but fails when try to download throughout uuid:

ConnectionError: HTTPSConnectionPool(host=‘dhusfeed.dhus.onda-dias.net’, port=443): Max retries exceeded with url: /gnss/odata/v1/Products(‘3f838f51-38ed-42b3-bf28-adb4e2a6badb’)/$value (Caused by NewConnectionError(’<urllib3.connection.VerifiedHTTPSConnection object at 0x7f16254ca2e0>: Failed to establish a new connection: [Errno -2] Name or service not known’))

In the information get by the query process. In the link appears https://dhusfeed.dhus.onda-dias.net/gnss instead of https://scihub.copernicus.eu/gnss/. Could be this the problem ? We are not able to access the first web adress. The link that shows this query do not correspond to the Download URL used in https://scihub.copernicus.eu/gnss/. Please see an example of the information retrieved by sentinelsat query:

{‘title’: ‘S1A_OPER_AUX_RESORB_OPOD_20210501T060101_V20210501T013304_20210501T045034’,
‘link’: “https://dhusfeed.dhus.onda-dias.net/gnss/odata/v1/Products(‘3f838f51-38ed-42b3-bf28-adb4e2a6badb’)/$value”,
‘link_alternative’: “https://dhusfeed.dhus.onda-dias.net/gnss/odata/v1/Products(‘3f838f51-38ed-42b3-bf28-adb4e2a6badb’)/”,
‘link_icon’: “https://dhusfeed.dhus.onda-dias.net/gnss/odata/v1/Products(‘3f838f51-38ed-42b3-bf28-adb4e2a6badb’)/Products(‘Quicklook’)/$value”,
‘summary’: ‘Date: 2021-05-01T01:33:04Z, Instrument: , Satellite: Sentinel-1, Size: 546.84 KB’,
‘ondemand’: ‘false’,
‘generationdate’: datetime.datetime(2021, 5, 1, 6, 1, 1),
‘beginposition’: datetime.datetime(2021, 5, 1, 1, 33, 4),
‘endposition’: datetime.datetime(2021, 5, 1, 4, 50, 34),
‘ingestiondate’: datetime.datetime(2021, 5, 1, 6, 10, 10, 182000),
‘format’: ‘EOF’,
‘size’: ‘546.84 KB’,
‘platformname’: ‘Sentinel-1’,
‘platformshortname’: ‘S1’,
‘platformnumber’: ‘A’,
‘platformserialidentifier’: ‘1A’,
‘filename’: ‘S1A_OPER_AUX_RESORB_OPOD_20210501T060101_V20210501T013304_20210501T045034.EOF’,
‘producttype’: ‘AUX_RESORB’,
‘filedescription’: ‘NRT POD Restituted Orbit File’,
‘fileclass’: ‘OPER’,
‘creator’: ‘OPOD’,
‘creatorversion’: ‘1.10.3’,
‘identifier’: ‘S1A_OPER_AUX_RESORB_OPOD_20210501T060101_V20210501T013304_20210501T045034’,
‘uuid’: ‘3f838f51-38ed-42b3-bf28-adb4e2a6badb’}

The SNAP sentinel 1 toolbox we are using is up to date (8.0.3).

Regards
Josep

1 Like