SEVERE: org.esa.snap.core.dataop.dem.ElevationFile: Illegal file name format: N55E023.SRTMGL1.hgt.zip

glemoine · November 28, 2018, 1:17pm

Dear s1tbx team,

I get the error in subject for a SRTM 1Sec HGT tile that was written to .snap/auxdata/dem/SRTM\ 1Sec\ HGT/ in a previous run (doing Terrain-Correction on a GRD tile). I have not changed anything in between runs. The process continues by downloading the tile from http://step.esa.int/auxdata/dem/SRTMGL1/ (twice! and once for N55E022).

GRD scene is: S1A_IW_GRDH_1SDV_20180523T043513_20180523T043538_022027_02614F_D349.zip

Although marked as SEVERE, the process completes fine. However, over scenes which are including non-existing SRTM tiles over sea (which I replace by empty “fake” tiles) this error breaks the process, obviously because it will never find the fake tile on the ESA server.

What is the reason for the error and can it, somehow, be circumvented?

Guido

glemoine · November 30, 2018, 9:58pm

For info, there is nothing in:

github.com

senbox-org/snap-engine/blob/master/snap-core/src/main/java/org/esa/snap/core/dataop/dem/ElevationFile.java

/*
 * Copyright (C) 2014 by Array Systems Computing Inc. http://www.array.ca
 *
 * This program is free software; you can redistribute it and/or modify it
 * under the terms of the GNU General Public License as published by the Free
 * Software Foundation; either version 3 of the License, or (at your option)
 * any later version.
 * This program is distributed in the hope that it will be useful, but WITHOUT
 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
 * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for
 * more details.
 *
 * You should have received a copy of the GNU General Public License along
 * with this program; if not, see http://www.gnu.org/licenses/
 */
package org.esa.snap.core.dataop.dem;

import org.esa.snap.core.dataio.ProductReader;
import org.esa.snap.core.datamodel.Product;
import org.esa.snap.core.dataop.downloadable.StatusProgressMonitor;

This file has been truncated. show original

that suggests that the error is thrown from this part. That makes it really hard to trace (and eventually solve).

mengdahl · December 1, 2018, 9:55am

Not sure if it is the cause but your path looks suspect

.snap/auxdata/dem/SRTM\ 1Sec\ HGT/

thho · December 1, 2018, 12:10pm

The path looks fine to me, checked it on my machine, same location, the / within the path, if this is what seems to be odd, are for escaping the whitespaces in the path.

lveci · December 1, 2018, 4:07pm

I’m not sure how to repeat the error. I terrain correct your scene, shut down, start up, try again, add elevation. It downloads the srtm 1 sec tiles onces and not again. What do you mean by fake tiles?

glemoine · December 3, 2018, 9:38am

Luis,

The fake tiles are related to this problem:

which was never solved. Thus, I decided to create empty tiles for sea covering tiles. This went fine until the Illegal file name format error started to pop up.

Guido

glemoine · December 3, 2018, 3:41pm

Is the source code actually in sync with the latest SNAP version. It is very curious that the “Illegal file name format” error thrown by this class is nowhere in the actual code (unless it is not actual).

marpet · December 3, 2018, 4:08pm

You should not look at the ‘master’ branch. This one will be the next major release.
Have a look at the maintenace branch named ‘6.x’

glemoine · December 3, 2018, 7:42pm

Thanks Marco,

Looks like this error has it’s origin in:

org.esa.snap.dem.dataio.srtm1_hgt.SRTM1HgtFileInfo

in a private class called EastingNorthingParser which looks like a very convoluted way to parse a tile name like N55E022, and throws so many ParseExceptions (which eventually pops up the “Illegal file name format” message) that it is impossible to guess where it fails exactly.

The code does not look inside the zipped tile at all, so what is inside doesn’t appear to matter much.

Guido

johntruckenbrodt · September 26, 2019, 2:22pm

any news on this? I am getting the same error.
I download the SRTM tiles externally into the SNAP auxdata structure because I re-use them for other purposes. SNAP however decides these files have illegal names and re-downloads them.