I am experiencing a weird issue when downloading products from the new Data Space portal. Once downloaded on my local computer, I’m trying to perform a TOPSAR Split operation but it seems the IW3 subswath is outside the raster boundaries (see captures). I’m using SNAP 9.0.0 and the issue can be reproduced using S1A_IW_SLC__1SDV_20230731T053520_20230731T053547_049663_05F8D1_C3A6. But as far as I investigate, the problem arises with any SLC IW products.
Interestingly, everything seems to work ok when I download a product from the old Scihub portal. The IW3 is part of the product raster and the TOPSAR Split operation is successful.
Looking at product metadata, I noticed raster dimension from Data Space and Scihub is also different:
Which I guess is consistent with the Split issue described above.
Please also note, I don’t modify the product at any stage, I ran this test on freshly downloaded, unedited products.
Does it sound familiar to somebody ? Thank you very much for your insights
After further investigation, it appears the issue shows up when SNAP directly opens the zipped product. When I unzip the product myself and open the unzipped product with SNAP, IW3 become visible as expected.
Maybe it relates to some built-in unzipping strategy ?
We’re also facing this issue. I went through the code with the debugger and javax.imageio.ImageIO encounters the following exception when trying to read the IW3 file: java.util.zip.ZipException: invalid LOC header (bad signature)
Stack trace:
java.util.zip.ZipException: invalid LOC header (bad signature)
at java.util.zip.ZipFile.read(Native Method)
at java.util.zip.ZipFile.access$1400(ZipFile.java:61)
at java.util.zip.ZipFile$ZipFileInputStream.read(ZipFile.java:741)
at javax.imageio.stream.FileCacheImageInputStream.readUntil(FileCacheImageInputStream.java:142)
at javax.imageio.stream.FileCacheImageInputStream.read(FileCacheImageInputStream.java:187)
at javax.imageio.stream.ImageInputStreamImpl.readFully(ImageInputStreamImpl.java:351)
at javax.imageio.stream.ImageInputStreamImpl.readFully(ImageInputStreamImpl.java:361)
at com.sun.media.imageioimpl.plugins.pnm.PNMImageReaderSpi.canDecodeInput(Unknown Source)
at javax.imageio.ImageIO$CanDecodeInputFilter.filter(ImageIO.java:567)
at javax.imageio.spi.FilterIterator.advance(ServiceRegistry.java:834)
at javax.imageio.spi.FilterIterator.<init>(ServiceRegistry.java:828)
at javax.imageio.spi.ServiceRegistry.getServiceProviders(ServiceRegistry.java:519)
at javax.imageio.ImageIO.getImageReaders(ImageIO.java:646)
at org.esa.s1tbx.io.geotiffxml.GeoTiffUtils.getTiffIIOReader(GeoTiffUtils.java:15)
at org.esa.s1tbx.io.sentinel1.Sentinel1Level1Directory.addImageFile(Sentinel1Level1Directory.java:90)
at org.esa.s1tbx.commons.io.AbstractProductDirectory.findImages(AbstractProductDirectory.java:141)
at org.esa.s1tbx.commons.io.AbstractProductDirectory.findImages(AbstractProductDirectory.java:168)
at org.esa.s1tbx.io.sentinel1.Sentinel1Level1Directory.createProduct(Sentinel1Level1Directory.java:987)
at org.esa.s1tbx.io.sentinel1.Sentinel1ProductReader.readProductNodesImpl(Sentinel1ProductReader.java:111)
at org.esa.snap.core.dataio.AbstractProductReader.readProductNodes(AbstractProductReader.java:178)
at org.esa.snap.core.gpf.common.ReadOp.initialize(ReadOp.java:168)
at org.esa.snap.core.gpf.internal.OperatorContext.initializeOperator(OperatorContext.java:528)
at org.esa.snap.core.gpf.internal.OperatorContext.getTargetProduct(OperatorContext.java:298)
at org.esa.snap.core.gpf.Operator.getTargetProduct(Operator.java:385)
at org.esa.snap.core.gpf.graph.NodeContext.initTargetProduct(NodeContext.java:77)
at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:199)
at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:182)
at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:182)
at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:182)
at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:182)
at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:182)
at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:182)
at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:182)
at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:182)
at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:182)
at org.esa.snap.core.gpf.graph.GraphContext.initOutput(GraphContext.java:166)
at org.esa.snap.core.gpf.graph.GraphContext.<init>(GraphContext.java:85)
at org.esa.snap.core.gpf.graph.GraphContext.<init>(GraphContext.java:58)
at org.esa.snap.core.gpf.graph.GraphProcessor.executeGraph(GraphProcessor.java:118)
I’ll also log a ticket on the Copernicus Data Space Ecosystem, because this might be something they have to fix on their end.
FYI, I reported the problem to the Copernicus Data Space Ecosystem on 30/08/2023.
I did some further investigation and provided came up with a minimal code snippet to reproduce the error in Java 1.8.
package org.example;
import java.io.IOException;
import java.io.InputStream;
import java.util.Enumeration;
import java.util.zip.ZipEntry;
import java.util.zip.ZipException;
import java.util.zip.ZipFile;
public class Main {
public static void main(String[] args) {
String zipPath = "/home/stijn/Downloads/S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.CDSE.zip";
try (ZipFile zipFile = new ZipFile(zipPath)) {
Enumeration<? extends ZipEntry> entries = zipFile.entries();
while (entries.hasMoreElements()) {
ZipEntry entry = entries.nextElement();
System.out.println(entry.getName());
if (!entry.isDirectory()) {
try (InputStream inputStream = zipFile.getInputStream(entry)) {
inputStream.read();
} catch (ZipException e) {
System.err.println("Failed to read " + entry.getName());
}
}
}
} catch (IOException e) {
throw new RuntimeException(e);
}
}
}
Output:
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/measurement/s1a-iw3-slc-vh-20230829t054321-20230829t054346-050086-0606e8-003.tiff
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/measurement/s1a-iw3-slc-vv-20230829t054321-20230829t054346-050086-0606e8-006.tiff
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/preview/icons/logo.png
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/preview/map-overlay.kml
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/preview/product-preview.html
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/preview/quick-look.png
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/preview/thumbnail.png
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/support/s1-level-1-calibration.xsd
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/support/s1-level-1-measurement.xsd
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/support/s1-level-1-noise.xsd
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/support/s1-level-1-product.xsd
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/support/s1-level-1-quicklook.xsd
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/support/s1-level-1-rfi.xsd
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/support/s1-map-overlay.xsd
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/support/s1-object-types.xsd
Failed to read S1A_IW_SLC__1SDV_20230829T054319_20230829T054347_050086_0606E8_2748.SAFE/support/s1-product-preview.xsd
I provided my findings on 06/09/2023, but the problem remains unsolved.
Since it is a compatibility issue with the built-in ZIP reader in Java 1.8, I’m afraid this cannot be solved easily on the side of SNAP either.
I have encountered the same problem with the one you have here. May I ask the full details on how you resolved this problem, or did you retrieve the IW3? Thank you and Godspeed!
This problem also introduces critical issues in the processing phase when the data is not read correctly, therefore a quick solution would be necessary
Has anyone encountered a ZipException: invalid LOC header when reading an IW3 file with javax.imageio.ImageIO? Could this be a Copernicus Data Space Ecosystem issue, or similar to file handling problems seen with Spotify?
This problem can be solved by unzipping the file, then open manifest.safe in SNAP. After opening the product you will see the IW3. Then reZip the file. By this process you can see the IW3 file in ZIP product.
