SNAP 7.0, Linux, 24 cores, 160G RAM
snap/gpt/pconvert RAM configs set to 145G
Dear Forum,
I have a Sentinel-2 mosaic of several granules in NetCDF4-BEAM and BEAM-DIMAP formats. When I export a full resolution RGB (right click on image > Export View as Image) SNAP immediately throws an error (The image could not be exported).
Same error occurs for all output formats.
It works on a smaller spatial subset and after some testing the threshold seems to be around 512 megapixel.
Doing the same directly with pconvert in debug mode doesnt work either. Looks like this:
~/snap/bin/pconvert -f png -s 1.0,6.0 -p subsets/msi_L1.rgb -d -o ./ mosaic.nc
INFO: org.esa.snap.core.gpf.operators.tooladapter.ToolAdapterIO: Initializing external tool adapters
SEVERE: org.esa.s2tbx.dataio.gdal.activator.GDALDistributionInstaller: The environment variable LD_LIBRARY_PATH is not set. It must contain the current folder ‘.’.
INFO: org.esa.snap.core.util.EngineVersionCheckActivator: Please check regularly for new updates for the best SNAP experience.
reading file mosaic.nc
SEVERE: org.esa.snap.core.dataio.ProductIO: Error attempting to read mosaic.nc with plugin reader org.csa.rstb.io.rcm.RCMProductReaderPlugIn@49a38b1: null
java.lang.NullPointerException
at org.esa.s1tbx.io.ceos.alos2.Alos2GeoTiffProductReaderPlugIn.checkFileName(Alos2GeoTiffProductReaderPlugIn.java:124)
at org.esa.s1tbx.io.ceos.alos2.Alos2GeoTiffProductReaderPlugIn.getDecodeQualification(Alos2GeoTiffProductReaderPlugIn.java:108)
at org.esa.snap.core.dataio.ProductIO.getProductReaderForInput(ProductIO.java:263)
at org.esa.snap.core.dataio.ProductIO.readProductImpl(ProductIO.java:214)
at org.esa.snap.core.dataio.ProductIO.readProduct(ProductIO.java:206)
at org.esa.snap.pconvert.PConvertMain.run(PConvertMain.java:496)
at org.esa.snap.pconvert.PConvertMain.main(PConvertMain.java:206)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.esa.snap.runtime.Launcher.lambda$run$0(Launcher.java:55)
at org.esa.snap.runtime.Engine.runClientCode(Engine.java:189)
at org.esa.snap.runtime.Launcher.run(Launcher.java:51)
at org.esa.snap.runtime.Launcher.main(Launcher.java:31)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.exe4j.runtime.LauncherEngine.launch(LauncherEngine.java:65)
at com.install4j.runtime.launcher.UnixLauncher.main(UnixLauncher.java:57)
SEVERE: org.esa.snap.core.dataio.ProductIO: Error attempting to read mosaic.nc with plugin reader org.esa.s1tbx.io.risat1.Risat1ProductReaderPlugIn@5785e813: null
snap-debug: VectorDataNode created: name=pins, featureType.typeName=org.esa.snap.Pin, placemarkDescriptor.class=class org.esa.snap.core.datamodel.PinDescriptor
snap-debug: VectorDataNode created: name=ground_control_points, featureType.typeName=org.esa.snap.GroundControlPoint, placemarkDescriptor.class=class org.esa.snap.core.datamodel.GcpDescriptor
WARNING: org.esa.snap.dataio.netcdf.util.MetadataUtils: Missing configuration property ‘snap.dataio.netcdf.metadataElementLimit’. Using default (100).
INFO: org.hsqldb.persist.Logger: dataFileCache open start
loading RGB profile from ‘/subsets/msi_L1.rgb’…
creating histogram for band ‘B4’…
snap-debug: Histogram: lower bin index = 0 (less than 1.0% of pixels skipped)
snap-debug: Histogram: upper bin index = 14 (less than 6.0% of pixels skipped)
snap-debug: Histogram: histo sample min = 0.0210999995470047; sample max = 0.05561464899801649
creating histogram for band ‘B3’…
snap-debug: Histogram: lower bin index = 0 (less than 1.0% of pixels skipped)
snap-debug: Histogram: upper bin index = 15 (less than 6.0% of pixels skipped)
snap-debug: Histogram: histo sample min = 0.04179999977350235; sample max = 0.07659687544219196
creating histogram for band ‘B2’…
snap-debug: Histogram: lower bin index = 1 (less than 1.0% of pixels skipped)
snap-debug: Histogram: upper bin index = 10 (less than 6.0% of pixels skipped)
snap-debug: Histogram: histo sample min = 0.07397109478188213; sample max = 0.09568203294475097
creating RGB image…
snap-debug: An exception occurred:
java.lang.NegativeArraySizeException
at org.esa.snap.core.util.ProductUtils.create3BandRgbImage(ProductUtils.java:322)
at org.esa.snap.core.util.ProductUtils.createRgbImage(ProductUtils.java:174)
at org.esa.snap.pconvert.PConvertMain.convertToImage(PConvertMain.java:600)
at org.esa.snap.pconvert.PConvertMain.run(PConvertMain.java:508)
at org.esa.snap.pconvert.PConvertMain.main(PConvertMain.java:206)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.esa.snap.runtime.Launcher.lambda$run$0(Launcher.java:55)
at org.esa.snap.runtime.Engine.runClientCode(Engine.java:189)
at org.esa.snap.runtime.Launcher.run(Launcher.java:51)
at org.esa.snap.runtime.Launcher.main(Launcher.java:31)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.exe4j.runtime.LauncherEngine.launch(LauncherEngine.java:65)
at com.install4j.runtime.launcher.UnixLauncher.main(UnixLauncher.java:57)
error: failed to create image: null
It takes a while but it seems the mosaic cannot even be read properly, and I wonder why the s1tbx is called for this task?
Does anyone know if theres a way to increase the max image size or another way to save such a large image in one go?
cheers
Daniel