Sen2Cor 2.5.5 error with new processing baseline (2.07)

Somehow I can’t use sen2cor on images after the beginning of November. Sen2cor processes the 60m resolution correctly (L2A files for 60m are there), then stops with:

[CRITICAL]  L2A_ProcessT: 230   Module L2A_ProcessTile-1 - L2A_T32UMV_A008714_20181106T103714 failed
[CRITICAL]  L2A_ProcessT: 230   Module L2A_ProcessTile-1 - L2A_T32UMV_A008714_20181106T103714 failed

While diggin through the logs, I found this:

Processing baseline 02.1 is not implemented yet.
Product version 14.5 will be used but errors during processing might occur.

My test product was S2B_MSIL1C_20181106T103219_N0207_R108_T32UMV_20181106T141912, and I saw that apparently a new processing baseline for L1C products (2.07) was introduced (see here). Can the error be related to that?

I am using sen2cor 2.5.5, and “older” products from October process without errors.

I have processed a product from 8th November and it seems to be working correctly. Sen2Cor terminated successfully with all bands exported. However, I do see the same warnings about the baseline not being implemented yet.

I will attempt to process the product that you are having issues with to see what happens.

OK thats interesting, I had the same error with a bunch of other products too…Did you to it in SNAP or with the standalone sen2cor?

If relevant, I use this version on Linux:
http://step.esa.int/thirdparties/sen2cor/2.5.5/Sen2Cor-02.05.05-Linux64.run

Your linked T32UMV tile also seemed to process fine for me. I use the same version of Sen2Cor on Linux.

Have you altered any options on the L2A_GIPP.xml file? Do you give a resolution tag to L2A_Process?

Hm, thats weird…no, I run L2A_Process without any parameters or a modified config file.

I just tried again, S2A_MSIL1C_20181101T103151_N0206_R108_T32UMV_20181101T110430 processes without any errors, while S2B_MSIL1C_20181106T103219_N0207_R108_T32UMV_20181106T141912 still fails.

I just did a fresh installation of sen2cor on a new machine and tried to process S2B_MSIL1C_20181106T103219_N0207_R108_T32UMV_20181106T141912without any parameters or anything - still fails with the same error.

user@box in ~/Sen2Cor-02.05.05-Linux64/bin
$ ./L2A_Process ~/S2B_MSIL1C_20181106T103219_N0207_R108_T32UMV_20181106T141912.SAFE/
Processing baseline 02.1 is not implemented yet.
Product version 14.5 will be used but errors during processing might occur.

Sentinel-2 Level 2A Processor (Sen2Cor). Version: 2.5.5, created: 2018.03.19, supporting Level-1C product version <= 14.5 started ...
Product version: 14.5. Operation mode: PDGS. Processing baseline: 02.07.
 No resolution specified, will process all resolutions.
Progress[%]: 0.01 : PID-2063, L2A_ProcessTile: processing with resolution 60 m, elapsed time[s]: 0.241, total: 0:00:01.693895
Progress[%]: 0.01 : PID-2063, L2A_ProcessTile: start of pre processing, elapsed time[s]: 0.000, total: 0:00:01.694099
Progress[%]: 0.01 : PID-2063, L2A_Tables: start import, elapsed time[s]: 0.032, total: 0:00:01.726088
Progress[%]: 0.04 : PID-2063, L2A_Tables: band B01 imported, elapsed time[s]: 0.776, total: 0:00:02.501608
Progress[%]: 0.78 : PID-2063, L2A_Tables: band B02 imported, elapsed time[s]: 18.889, total: 0:00:21.390322
Progress[%]: 1.52 : PID-2063, L2A_Tables: band B03 imported, elapsed time[s]: 18.734, total: 0:00:40.124223
Progress[%]: 2.27 : PID-2063, L2A_Tables: band B04 imported, elapsed time[s]: 19.165, total: 0:00:59.289666
Progress[%]: 2.50 : PID-2063, L2A_Tables: band B05 imported, elapsed time[s]: 5.911, total: 0:01:05.201065
Progress[%]: 2.74 : PID-2063, L2A_Tables: band B06 imported, elapsed time[s]: 6.034, total: 0:01:11.235553
Progress[%]: 2.97 : PID-2063, L2A_Tables: band B07 imported, elapsed time[s]: 6.074, total: 0:01:17.309896
Progress[%]: 3.22 : PID-2063, L2A_Tables: band B8A imported, elapsed time[s]: 6.244, total: 0:01:23.554185
Progress[%]: 3.25 : PID-2063, L2A_Tables: band B09 imported, elapsed time[s]: 0.793, total: 0:01:24.347158
Progress[%]: 3.28 : PID-2063, L2A_Tables: band B10 imported, elapsed time[s]: 0.723, total: 0:01:25.069960
Progress[%]: 3.49 : PID-2063, L2A_Tables: band B11 imported, elapsed time[s]: 5.473, total: 0:01:30.542893
Progress[%]: 3.71 : PID-2063, L2A_Tables: band B12 imported, elapsed time[s]: 5.434, total: 0:01:35.977314
Progress[%]: 3.71 : PID-2063, L2A_ProcessTile: start of Scene Classification, elapsed time[s]: 0.003, total: 0:01:35.979932
Progress[%]: 3.71 : PID-2063, Pre process   , elapsed time[s]: 0.086, total: 0:01:36.065605
Progress[%]: 3.73 : PID-2063, L2A_SC init   , elapsed time[s]: 0.385, total: 0:01:36.450765
Progress[%]: 3.73 : PID-2063, L2A_CSND_1_1  , elapsed time[s]: 0.108, total: 0:01:36.559068
Progress[%]: 3.73 : PID-2063, L2A_CSND_1_2  , elapsed time[s]: 0.115, total: 0:01:36.674376
Progress[%]: 3.74 : PID-2063, L2A_CSND_2_0  , elapsed time[s]: 0.124, total: 0:01:36.798723
Progress[%]: 3.74 : PID-2063, L2A_CSND_2_1  , elapsed time[s]: 0.108, total: 0:01:36.906862
Progress[%]: 3.75 : PID-2063, L2A_CSND_2_1_2, elapsed time[s]: 0.084, total: 0:01:36.990647
Progress[%]: 3.75 : PID-2063, L2A_CSND_2_2  , elapsed time[s]: 0.055, total: 0:01:37.045537
Progress[%]: 3.75 : PID-2063, L2A_CSND_2_3  , elapsed time[s]: 0.055, total: 0:01:37.100053
Progress[%]: 3.75 : PID-2063, L2A_CSND_2_4  , elapsed time[s]: 0.096, total: 0:01:37.196103
Progress[%]: 3.76 : PID-2063, L2A_CSND_2_5  , elapsed time[s]: 0.157, total: 0:01:37.352715
Progress[%]: 3.76 : PID-2063, L2A_SnowPostProcessingCCI  , elapsed time[s]: 0.001, total: 0:01:37.353634
Progress[%]: 3.77 : PID-2063, L2A_CSND_3    , elapsed time[s]: 0.159, total: 0:01:37.512885
Progress[%]: 3.77 : PID-2063, L2A_CSND_5_1  , elapsed time[s]: 0.149, total: 0:01:37.661902
Progress[%]: 3.78 : PID-2063, L2A_CSND_5_2  , elapsed time[s]: 0.251, total: 0:01:37.913072
Progress[%]: 3.79 : PID-2063, L2A_CSND_6    , elapsed time[s]: 0.181, total: 0:01:38.094156
Progress[%]: 3.79 : PID-2063, L2A_CSND_6_2  , elapsed time[s]: 0.115, total: 0:01:38.209300
Progress[%]: 3.80 : PID-2063, L2A_CSND_7    , elapsed time[s]: 0.144, total: 0:01:38.353545
Progress[%]: 3.92 : PID-2063, L2A_SHD       , elapsed time[s]: 2.966, total: 0:01:41.319707
Progress[%]: 3.92 : PID-2063, DV recovery   , elapsed time[s]: 0.143, total: 0:01:41.462658
Progress[%]: 3.93 : PID-2063, WP recovery   , elapsed time[s]: 0.156, total: 0:01:41.618259
Progress[%]: 3.93 : PID-2063, WP recovery with CCI Water Bodies at 150m  , elapsed time[s]: 0.001, total: 0:01:41.619190
Progress[%]: 3.94 : PID-2063, Snow recovery , elapsed time[s]: 0.183, total: 0:01:41.801776
Progress[%]: 3.94 : PID-2063, Soil recovery , elapsed time[s]: 0.079, total: 0:01:41.880596
Progress[%]: 3.94 : PID-2063, Land recovery with B10, B09 and B8A , elapsed time[s]: 0.001, total: 0:01:41.881545
Progress[%]: 3.94 : PID-2063, Cirrus recovery with B10 , elapsed time[s]: 0.001, total: 0:01:41.882254
Progress[%]: 3.94 : PID-2063, Urban and Bare pixel recovery with CCI Land Cover Map at 300 m , elapsed time[s]: 0.001, total: 0:01:41.882928
Progress[%]: 3.95 : PID-2063, Post process  , elapsed time[s]: 0.300, total: 0:01:42.182480
Progress[%]: 3.95 : PID-2063, L2A_ProcessTile: start of Atmospheric Correction, elapsed time[s]: 0.000, total: 0:01:42.182881
Progress[%]: 3.96 : PID-2063, L2A_AtmCorr: end of calculation terrain maps, elapsed time[s]: 0.169, total: 0:01:42.352144
Progress[%]: 3.96 : PID-2063, L2A_AtmCorr: start of AOT retrieval at 550nm, elapsed time[s]: 0.000, total: 0:01:42.352489
Progress[%]: 3.99 : PID-2063, L2A_AtmCorr: end of internal classification, elapsed time[s]: 0.830, total: 0:01:43.182497
Progress[%]: 4.00 : PID-2063, L2A_AtmCorr: end of interpolation LUTs, elapsed time[s]: 0.340, total: 0:01:43.522027
Progress[%]: 4.00 : PID-2063, L2A_AtmCorr: end retrieving reference pixels for dark areas, elapsed time[s]: 0.000, total: 0:01:43.522246
Progress[%]: 4.11 : PID-2063, L2A_AtmCorr: end of check for dense bright vegetation pixels, elapsed time[s]: 2.769, total: 0:01:46.290956
Progress[%]: 4.14 : PID-2063, L2A_AtmCorr: end of receiving atmospheric functions for all altitudes and visibilities, elapsed time[s]: 0.759, total: 0:01:47.050268
Progress[%]: 4.14 : PID-2063, L2A_AtmCorr: end of AOT retrieval at 550nm, elapsed time[s]: 0.000, total: 0:01:47.050512
Progress[%]: 4.14 : PID-2063, L2A_AtmCorr: start of water vapour retrieval, elapsed time[s]: 0.002, total: 0:01:47.052157
Progress[%]: 4.16 : PID-2063, L2A_AtmCorr: end of water vapour retrieval preparation, elapsed time[s]: 0.420, total: 0:01:47.472246
Progress[%]: 4.61 : PID-2063, L2A_AtmCorr: end of water vapour retrieval, elapsed time[s]: 11.473, total: 0:01:58.945087
Progress[%]: 4.61 : PID-2063, L2A_AtmCorr: preparation of surface reflectance retrieval, elapsed time[s]: 0.000, total: 0:01:58.945321
Progress[%]: 4.73 : PID-2063, L2A_AtmCorr: end of surface reflectance retrieval preparation, elapsed time[s]: 3.083, total: 0:02:02.028621
Progress[%]: 5.18 : PID-2063, L2A_AtmCorr: end of surface reflectance retrieval, elapsed time[s]: 11.581, total: 0:02:13.609374
Progress[%]: 5.33 : PID-2063, L2A_AtmCorr: end of rho retrieval step 2, elapsed time[s]: 3.681, total: 0:02:17.290513
Progress[%]: 5.33 : PID-2063, L2A_ProcessTile: start of post processing, elapsed time[s]: 0.004, total: 0:02:17.294939
Progress[%]: 5.33 : PID-2063, L2A_Tables: start export, elapsed time[s]: 0.001, total: 0:02:17.296356
Progress[%]: 5.37 : PID-2063, L2A_Tables: band B01 exported, elapsed time[s]: 1.017, total: 0:02:18.313244
Progress[%]: 5.41 : PID-2063, L2A_Tables: band B02 exported, elapsed time[s]: 1.028, total: 0:02:19.341676
Progress[%]: 5.45 : PID-2063, L2A_Tables: band B03 exported, elapsed time[s]: 1.049, total: 0:02:20.390692
Progress[%]: 5.49 : PID-2063, L2A_Tables: band B04 exported, elapsed time[s]: 1.007, total: 0:02:21.398012
Progress[%]: 5.53 : PID-2063, L2A_Tables: band B05 exported, elapsed time[s]: 1.004, total: 0:02:22.401723
Progress[%]: 5.57 : PID-2063, L2A_Tables: band B06 exported, elapsed time[s]: 1.004, total: 0:02:23.406016
Progress[%]: 5.61 : PID-2063, L2A_Tables: band B07 exported, elapsed time[s]: 0.994, total: 0:02:24.400473
Progress[%]: 5.64 : PID-2063, L2A_Tables: band B8A exported, elapsed time[s]: 0.997, total: 0:02:25.397497
Progress[%]: 5.69 : PID-2063, L2A_Tables: band B09 exported, elapsed time[s]: 1.070, total: 0:02:26.467191
Progress[%]: 5.72 : PID-2063, L2A_Tables: band B11 exported, elapsed time[s]: 0.961, total: 0:02:27.428369
Progress[%]: 5.76 : PID-2063, L2A_Tables: band B12 exported, elapsed time[s]: 0.921, total: 0:02:28.349740
Progress[%]: 5.76 : PID-2063, L2A_Tables: band SCL exported, elapsed time[s]: 0.072, total: 0:02:28.422132
Progress[%]: 5.77 : PID-2063, L2A_Tables: band SNW exported, elapsed time[s]: 0.063, total: 0:02:28.484786
Progress[%]: 5.77 : PID-2063, L2A_Tables: band CLD exported, elapsed time[s]: 0.164, total: 0:02:28.649105
Progress[%]: 5.78 : PID-2063, L2A_Tables: band AOT exported, elapsed time[s]: 0.068, total: 0:02:28.717063
Progress[%]: 5.78 : PID-2063, L2A_Tables: band WVP exported, elapsed time[s]: 0.072, total: 0:02:28.788815
Progress[%]: 5.78 : PID-2063, L2A_Tables: band PVI exported, elapsed time[s]: 0.151, total: 0:02:28.939742
Progress[%]: 5.81 : PID-2063, L2A_Tables: band TCI exported, elapsed time[s]: 0.579, total: 0:02:29.519066
Progress[%]: 5.81 : PID-2063, L2A_Tables: stop export, elapsed time[s]: 0.014, total: 0:02:29.533540
[CRITICAL]  L2A_ProcessT: 230   Module L2A_ProcessTile-1 - L2A_T32UMV_A008714_20181106T103714 failed
[CRITICAL]  L2A_ProcessT: 230   Module L2A_ProcessTile-1 - L2A_T32UMV_A008714_20181106T103714 failed

I’ve had a brief investigation, but I don’t seem to be able to reproduce the problem. The only difference that I notice is that your error refers to “L2A_ProcessTile-1”, whereas my output has “Progress[%]: 6.23 : PID-27123, L2A_ProcessTile: processing with resolution 20 m, elapsed time[s]: 0.827, total: 0:02:20.744167”

I’m not sure of the difference in these module name is significant here. I would not know how to rectify this, if this is the case.


Edit:
It seems that your L2A_ProcessTile.py is failing around line 230 as the postprocess() is set to False somehow. I’m not quite sure why this is different to how mine operates, but you could start investigating here.

You can try setting your “Operation_Mode” to “TOOLBOX” in L2A_GIPP.xml as it seems to set up the configuration differently. However, I’m not an expert on the differences here, and can’t really help much further.

Changing the operation mode didn’t help, but I figured out that when I process the resolutions one after another (first 60m, then 20 and 10m), that I still get the error after 20m and 10m (60m processes without errors), but the resulting files are written as they should. I am still not sure what causes this, but for now I use this as a workaround.

This error is common. The workaround is to run Sen2Cor at each scale separately, i.e. 3 times. If the error persists, i.e., if no file is written, close SNAP, re-open it and process at the chosen scale (20 m if 60m is already written, 10m if 20 m is written).

1 Like

Hi buddy. I had this problem just right now and I already solve it easyly: just change your file to desktop (sen2cor generates mistakes when the path is too long).

I hope that it works for you. Regards!