Snap2stamps package: a free tool to automate the SNAP-StaMPS Workflow

had you checked the log while doing the splitting?
the message says that expects split products… so probably there was something wrong…
no issues with S1A-S1B

Split_proc_stdout.log says split slave successfully completed in each folder whereas in coreg_if_proc_stdout.log ‘error in computing coregistration and interferogram generation of splitted slave’

Well… again. The error says Split product expected. So please check what you did or its results.
Can you open some in SNAP and see it?

image

is this the original footprint?
Or the splitted one?

Please put one original footprint next so we can see…
I agree than one image counts 1000 words, but please do not save letters to explain what you got, or it would be more difficult to help

2 Likes

Hi,ifg and coreg directory is empty,attacted project.conf and split_proc_stdout.log and coreg_ifg_proc_stdout.log,please help me,thank you .
ubuntu18, snap6,7 images.
1/project.conf:
######### CONFIGURATION FILE ######
###################################

PROJECT DEFINITION

PROJECTFOLDER=/mnt/hgfs/PSI_proc
GRAPHSFOLDER=/mnt/hgfs/PSI_proc/graphs
##################################

PROCESSING PARAMETERS

IW1=IW2
MASTER=/mnt/hgfs/PSI_proc/master/20191121_Spl_Orb.dim
##################################

AOI BBOX DEFINITION

LONMIN=110.69
LATMIN=32.62
LONMAX=110.82
LATMAX=32.69
##################################

SNAP GPT

GPTBIN_PATH=/home/yzx/snap/bin/gpt
##################################

COMPUTING RESOURCES TO EMPLOY

CPU=4
CACHE=12G
##################################

2/split_proc_stdout.log:

#####################################################################

TOPSAR Splitting and Apply Orbit

#####################################################################
[1] Folder: 20190712
/mnt/hgfs/PSI_proc/slaves/20190712
[’/mnt/hgfs/PSI_proc/slaves/20190712/S1A_IW_SLC__1SDV_20190712T103619_20190712T103646_028083_032BE5_B65B.zip’]
[’/home/yzx/snap/bin/gpt’, ‘/mnt/hgfs/PSI_proc/graphs/splitgraph2run.xml’, ‘-c’, ‘12G’, ‘-q’, ‘4’]
[1] Finished process in 174.149184942 seconds.
Split slave [’/mnt/hgfs/PSI_proc/slaves/20190712/S1A_IW_SLC__1SDV_20190712T103619_20190712T103646_028083_032BE5_B65B.zip’] successfully completed.

#####################################################################
[2] Folder: 20190817
/mnt/hgfs/PSI_proc/slaves/20190817
[’/mnt/hgfs/PSI_proc/slaves/20190817/S1A_IW_SLC__1SDV_20190817T103622_20190817T103649_028608_033C71_D8CB.zip’]
[’/home/yzx/snap/bin/gpt’, ‘/mnt/hgfs/PSI_proc/graphs/splitgraph2run.xml’, ‘-c’, ‘12G’, ‘-q’, ‘4’]
[2] Finished process in 607.711601973 seconds.
Split slave [’/mnt/hgfs/PSI_proc/slaves/20190817/S1A_IW_SLC__1SDV_20190817T103622_20190817T103649_028608_033C71_D8CB.zip’] successfully completed.

#####################################################################
[3] Folder: 20190922
/mnt/hgfs/PSI_proc/slaves/20190922
[’/mnt/hgfs/PSI_proc/slaves/20190922/S1A_IW_SLC__1SDV_20190922T103623_20190922T103650_029133_034EA1_D49E.zip’]
[’/home/yzx/snap/bin/gpt’, ‘/mnt/hgfs/PSI_proc/graphs/splitgraph2run.xml’, ‘-c’, ‘12G’, ‘-q’, ‘4’]
[3] Finished process in 116.058011055 seconds.
Split slave [’/mnt/hgfs/PSI_proc/slaves/20190922/S1A_IW_SLC__1SDV_20190922T103623_20190922T103650_029133_034EA1_D49E.zip’] successfully completed.

#####################################################################
[4] Folder: 20191028
/mnt/hgfs/PSI_proc/slaves/20191028
[’/mnt/hgfs/PSI_proc/slaves/20191028/S1A_IW_SLC__1SDV_20191028T103624_20191028T103651_029658_0360B8_62AF.zip’]
[’/home/yzx/snap/bin/gpt’, ‘/mnt/hgfs/PSI_proc/graphs/splitgraph2run.xml’, ‘-c’, ‘12G’, ‘-q’, ‘4’]
[4] Finished process in 119.040776968 seconds.
Split slave [’/mnt/hgfs/PSI_proc/slaves/20191028/S1A_IW_SLC__1SDV_20191028T103624_20191028T103651_029658_0360B8_62AF.zip’] successfully completed.

#####################################################################
[5] Folder: 20191215
/mnt/hgfs/PSI_proc/slaves/20191215
[’/mnt/hgfs/PSI_proc/slaves/20191215/S1A_IW_SLC__1SDV_20191215T103622_20191215T103649_030358_037911_DC80.zip’]
[’/home/yzx/snap/bin/gpt’, ‘/mnt/hgfs/PSI_proc/graphs/splitgraph2run.xml’, ‘-c’, ‘12G’, ‘-q’, ‘4’]
[5] Finished process in 116.777863979 seconds.
Split slave [’/mnt/hgfs/PSI_proc/slaves/20191215/S1A_IW_SLC__1SDV_20191215T103622_20191215T103649_030358_037911_DC80.zip’] successfully completed.

#####################################################################
[6] Folder: 20200108
/mnt/hgfs/PSI_proc/slaves/20200108
[’/mnt/hgfs/PSI_proc/slaves/20200108/S1A_IW_SLC__1SDV_20200108T103621_20200108T103648_030708_03852A_A4E0.zip’]
[’/home/yzx/snap/bin/gpt’, ‘/mnt/hgfs/PSI_proc/graphs/splitgraph2run.xml’, ‘-c’, ‘12G’, ‘-q’, ‘4’]
[6] Finished process in 62.7393319607 seconds.
Split slave [’/mnt/hgfs/PSI_proc/slaves/20200108/S1A_IW_SLC__1SDV_20200108T103621_20200108T103648_030708_03852A_A4E0.zip’] successfully completed.

#####################################################################

3/coreg_ifg_proc_stdout.log:

#####################################################################

Coregistration and Interferogram computation started:

#####################################################################
[1] Processing slave file :20190712_IW2.dim
[1] Finished process in 5.91212487221 seconds.
Error computing with coregistration and interferogram generation of splitted slave /mnt/hgfs/PSI_proc/split/20190712/20190712_IW2.dim

#####################################################################
[2] Processing slave file :20190817_IW2.dim
[2] Finished process in 5.69649815559 seconds.
Error computing with coregistration and interferogram generation of splitted slave /mnt/hgfs/PSI_proc/split/20190817/20190817_IW2.dim

#####################################################################
[3] Processing slave file :20190922_IW2.dim
[3] Finished process in 5.75354981422 seconds.
Error computing with coregistration and interferogram generation of splitted slave /mnt/hgfs/PSI_proc/split/20190922/20190922_IW2.dim

#####################################################################
[4] Processing slave file :20191028_IW2.dim
[4] Finished process in 5.35769581795 seconds.
Error computing with coregistration and interferogram generation of splitted slave /mnt/hgfs/PSI_proc/split/20191028/20191028_IW2.dim

#####################################################################
[5] Processing slave file :20191215_IW2.dim
[5] Finished process in 5.38097500801 seconds.
Error computing with coregistration and interferogram generation of splitted slave /mnt/hgfs/PSI_proc/split/20191215/20191215_IW2.dim

#####################################################################
[6] Processing slave file :20200108_IW2.dim
[6] Finished process in 5.70135998726 seconds.
Error computing with coregistration and interferogram generation of splitted slave /mnt/hgfs/PSI_proc/split/20200108/20200108_IW2.dim

#####################################################################

The splitting looks fine to me.
Can you check the master?

the master and splited slaves all looks fine. I wonder maybe the reason is the name of master which is MASTER=/mnt/hgfs/PSI_proc/master/20191121_Spl_Orb.dim?

1 Like

Original
image

Split
image

Image ID
image

Project.conf file

######### CONFIGURATION FILE ######
###################################

PROJECT DEFINITION

PROJECTFOLDER=/application/pi/Desktop/test/Automated/Sentinel-1 Data/Ascending/project
GRAPHSFOLDER=/application/pi/Desktop/test/snap2stamps-1.0.1/graphs
##################################

PROCESSING PARAMETERS

IW1=IW2
MASTER=/application/pi/Desktop/test/Automated/Sentinel-1 Data/Ascending/project/master/S1A_IW_SLC__1SDV_20200129T100634_20200129T100701_031014_038FF7_6B11.zip
##################################

AOI BBOX DEFINITION

LONMIN=121.212000000
LATMIN=13.563300000
LONMAX=120.942000000
LATMAX=13.903100000
##################################

SNAP GPT

GPTBIN_PATH=/application/pi/snap/bin/gpt
##################################

COMPUTING RESOURCES TO EMPLOY

CPU=3
CACHE=10G
##################################

Log files

#####################################################################

TOPSAR Splitting and Apply Orbit

#####################################################################
[1] Folder: 20191206
/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20191206
[’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20191206/S1B_IW_SLC__1SDV_20191206T100551_20191206T100618_019243_02454C_38F3.zip’]
[’/application/pi/snap/bin/gpt’, ‘/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/graphs/splitgraph2run.xml’, ‘-c’, ‘10G’, ‘-q’, ‘3’]
[1] Finished process in 64.6971108913 seconds.
Split slave [’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20191206/S1B_IW_SLC__1SDV_20191206T100551_20191206T100618_019243_02454C_38F3.zip’] successfully completed.

#####################################################################
[2] Folder: 20191218
/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20191218
[’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20191218/S1B_IW_SLC__1SDV_20191218T100551_20191218T100618_019418_024AE3_D50C.zip’]
[’/application/pi/snap/bin/gpt’, ‘/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/graphs/splitgraph2run.xml’, ‘-c’, ‘10G’, ‘-q’, ‘3’]
[2] Finished process in 45.4391438961 seconds.
Split slave [’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20191218/S1B_IW_SLC__1SDV_20191218T100551_20191218T100618_019418_024AE3_D50C.zip’] successfully completed.

#####################################################################
[3] Folder: 20191230
/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20191230
[’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20191230/S1B_IW_SLC__1SDV_20191230T100550_20191230T100617_019593_025071_D531.zip’]
[’/application/pi/snap/bin/gpt’, ‘/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/graphs/splitgraph2run.xml’, ‘-c’, ‘10G’, ‘-q’, ‘3’]
[3] Finished process in 43.8650829792 seconds.
Split slave [’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20191230/S1B_IW_SLC__1SDV_20191230T100550_20191230T100617_019593_025071_D531.zip’] successfully completed.

#####################################################################
[4] Folder: 20200111
/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200111
[’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200111/S1B_IW_SLC__1SDV_20200111T100550_20200111T100617_019768_025603_D13C.zip’]
[’/application/pi/snap/bin/gpt’, ‘/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/graphs/splitgraph2run.xml’, ‘-c’, ‘10G’, ‘-q’, ‘3’]
[4] Finished process in 45.3274641037 seconds.
Split slave [’/application/pi/Desktop/Test/Automated/Sentinel-1
Data/Ascending/slaves/20200111/S1B_IW_SLC__1SDV_20200111T100550_20200111T100617_019768_025603_D13C.zip’] successfully completed.

#####################################################################
[5] Folder: 20200117
/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200117
[’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200117/S1A_IW_SLC__1SDV_20200117T100630_20200117T100706_030839_0389D0_7285.zip’]
[’/application/pi/snap/bin/gpt’, ‘/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/graphs/splitgraph2run.xml’, ‘-c’, ‘10G’, ‘-q’, ‘3’]
[5] Finished process in 50.9810740948 seconds.
Split slave [’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200117/S1A_IW_SLC__1SDV_20200117T100630_20200117T100706_030839_0389D0_7285.zip’] successfully completed.

#####################################################################
[6] Folder: 20200123
/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200123
[’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200123/S1B_IW_SLC__1SDV_20200123T100549_20200123T100616_019943_025B95_4580.zip’]
[’/application/pi/snap/bin/gpt’, ‘/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/graphs/splitgraph2run.xml’, ‘-c’, ‘10G’, ‘-q’, ‘3’]
[6] Finished process in 41.303935051 seconds.
Split slave [’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200123/S1B_IW_SLC__1SDV_20200123T100549_20200123T100616_019943_025B95_4580.zip’] successfully completed.

#####################################################################
[7] Folder: 20200204
/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200204
[’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200204/S1B_IW_SLC__1SDV_20200204T100549_20200204T100616_020118_026141_8BA5.zip’]
[’/application/pi/snap/bin/gpt’, ‘/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/graphs/splitgraph2run.xml’, ‘-c’, ‘10G’, ‘-q’, ‘3’]
[7] Finished process in 42.7698760033 seconds.
Split slave [’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200204/S1B_IW_SLC__1SDV_20200204T100549_20200204T100616_020118_026141_8BA5.zip’] successfully completed.

#####################################################################
[8] Folder: 20200210
/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200210
[’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200210/S1A_IW_SLC__1SDV_20200210T100633_20200210T100700_031189_039610_A842.zip’]
[’/application/pi/snap/bin/gpt’, ‘/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/graphs/splitgraph2run.xml’, ‘-c’, ‘10G’, ‘-q’, ‘3’]
[8] Finished process in 44.0691168308 seconds.
Split slave [’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200210/S1A_IW_SLC__1SDV_20200210T100633_20200210T100700_031189_039610_A842.zip’] successfully completed.

#####################################################################
[9] Folder: 20200216
/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200216
[’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200216/S1B_IW_SLC__1SDV_20200216T100549_20200216T100616_020293_0266E2_DC27.zip’]
[’/application/pi/snap/bin/gpt’, ‘/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/graphs/splitgraph2run.xml’, ‘-c’, ‘10G’, ‘-q’, ‘3’]
[9] Finished process in 41.9490730762 seconds.
Split slave [’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200216/S1B_IW_SLC__1SDV_20200216T100549_20200216T100616_020293_0266E2_DC27.zip’] successfully completed.

#####################################################################
[10] Folder: 20200222
/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200222
[’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200222/S1A_IW_SLC__1SDV_20200222T100633_20200222T100700_031364_039C16_F035.zip’]
[’/application/pi/snap/bin/gpt’, ‘/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/graphs/splitgraph2run.xml’, ‘-c’, ‘10G’, ‘-q’, ‘3’]
[10] Finished process in 40.2704799175 seconds.
Split slave [’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200222/S1A_IW_SLC__1SDV_20200222T100633_20200222T100700_031364_039C16_F035.zip’] successfully completed.

#####################################################################
[11] Folder: 20200228
/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200228
[’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200228/S1B_IW_SLC__1SDV_20200228T100548_20200228T100615_020468_026C7F_F35E.zip’]
[’/application/pi/snap/bin/gpt’, ‘/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/graphs/splitgraph2run.xml’, ‘-c’, ‘10G’, ‘-q’, ‘3’]
[11] Finished process in 42.9717028141 seconds.
Split slave [’/application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/slaves/20200228/S1B_IW_SLC__1SDV_20200228T100548_20200228T100615_020468_026C7F_F35E.zip’] successfully completed.

#####################################################################

Coregistration and Interferogram computation started:

#####################################################################

[1] Processing slave file :20200210_IW2.dim

[1] Finished process in 23.0236289501 seconds.

Error computing with coregistration and interferogram generation of splitted slave /application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/project/split/20200210/20200210_IW2.dim

#####################################################################

[2] Processing slave file :20200123_IW2.dim

[2] Finished process in 8.3858089447 seconds.

Error computing with coregistration and interferogram generation of splitted slave /application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/project/split/20200123/20200123_IW2.dim

#####################################################################

[3] Processing slave file :20191230_IW2.dim

[3] Finished process in 8.42819213867 seconds.

Error computing with coregistration and interferogram generation of splitted slave /application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/project/split/20191230/20191230_IW2.dim

#####################################################################

[4] Processing slave file :20200222_IW2.dim

[4] Finished process in 8.34225106239 seconds.

Error computing with coregistration and interferogram generation of splitted slave /application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/project/split/20200222/20200222_IW2.dim

#####################################################################

[5] Processing slave file :20200117_IW2.dim

[5] Finished process in 8.29769206047 seconds.

Error computing with coregistration and interferogram generation of splitted slave /application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/project/split/20200117/20200117_IW2.dim

#####################################################################

[6] Processing slave file :20200204_IW2.dim

[6] Finished process in 8.23489403725 seconds.

Error computing with coregistration and interferogram generation of splitted slave /application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/project/split/20200204/20200204_IW2.dim

#####################################################################

[7] Processing slave file :20191218_IW2.dim

[7] Finished process in 8.35906600952 seconds.

Error computing with coregistration and interferogram generation of splitted slave /application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/project/split/20191218/20191218_IW2.dim

#####################################################################

[8] Processing slave file :20200111_IW2.dim

[8] Finished process in 8.42550802231 seconds.

Error computing with coregistration and interferogram generation of splitted slave /application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/project/split/20200111/20200111_IW2.dim

#####################################################################

[9] Processing slave file :20200228_IW2.dim

[9] Finished process in 8.3898100853 seconds.

Error computing with coregistration and interferogram generation of splitted slave /application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/project/split/20200228/20200228_IW2.dim

#####################################################################

[10] Processing slave file :20200216_IW2.dim

[10] Finished process in 8.70642399788 seconds.

Error computing with coregistration and interferogram generation of splitted slave /application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/project/split/20200216/20200216_IW2.dim

#####################################################################

[11] Processing slave file :20191206_IW2.dim

[11] Finished process in 8.34725189209 seconds.

Error computing with coregistration and interferogram generation of splitted slave /application/pi/Desktop/Test/Automated/Sentinel-1 Data/Ascending/project/split/20191206/20191206_IW2.dim

#####################################################################

Sorry for inconvenience caused due to lack of information.

I also noticed this. Maybe it is required to stick to the actual name of the master proposed by SNAP, as suggested by @mdelgado in this post:

thank you @ABraun ,I’ll follow your instruction and have a try ,feedback will be very soon

Not sure but the splitted ones, do not look like to contain full subswath. How had you splitted them?
Can you show the split2run.xml

maybe @gokulanand makes the same fault which result in the same error ,it is about the master file as a zip format not a dim one .

2 Likes

@yzxtll is right. Thanks for pointing it out

I saved master as dim product and changed the file type to .dim. Still I get the same error. I have this doubt,

SNAP GPT

GPTBIN_PATH=/application/pi/snap/bin/gpt

the gpt is not a folder in my system it is a file

. Should I change the path by removing ‘/gpt’ ?

If the scripts were already called correctly (as you have shown us above), the gpt is not the problem.

You have to pre-process the master:

  1. Apply TOPS Split
  2. Apply Orbit File

stick to the name that SNAP suggests and enter the full path to the master in the config file.

MASTER=Data/Ascending/project/master/S1A_IW_SLC__1SDV_20200129T100634_20200129T100701_031014_038FF7_6B11_Split_Orb.dim

2 Likes

Thank you for the correction. I have new problems coming up in ESD. After a quick overlook throughout the trail I come to know that it is because of SNAP 7 and snap2stamps is mainly made for SNAP 6. I will try to update the scripts by the instruction given by @mdelgado. If not successful I will wait for the latest snap2stamps update. Thanks again for the support. :+1:

hello,
did it work out?
i tried to take the full sub-swath so the processing took much time and at each ifg it gave me an error: japa heap space!

I’ve run a snap2stamps stack of 26 images ,When I download a new S1SLC image ,Could I createa new a directory named image date(eg:20200507) into slaves folder and copy the ZIP image(eg:S1A_IW_SLC__1SDV_20200507T103622_20200507T103649_032458_03C23E_7AC5.zip) into the directory manully, then run step 2 “python splitting_slaves.py project.conf” skipping “python slaves_prep.py project.conf”?

yes, if you stick to the folder structure, you can skip the slaves_prep command. However, the current configuration runs later commands (splitting_slaves) for all data in the split folder, regardless if the outputs already exist or not.

This is the work-around: