Is there maybe a way to use a different download url? Where does the url to http://skywatch-auxdata.s3-us-west-2.amazonaws.com come from? I was hoping I could change that with the settings in etc/snap.auxdata.properties but no luck. Any pointer appreciated.
We’re also getting the same problem, with SNAP then sitting in a loop on the 403 error.
The Skywatch URL returns “AccessDenied”. However, it is available via the aws s3 command line (e.g. “aws s3 ls s3://skywatch-auxdata/dem/SRTM90/tiff/”). This suggests that the S3 bucket has been locked down for public access via HTTP, which SNAP is using for the download. If SNAP only uses the public HTTP endpoint, then I don’t think there is an alternative for the download.
Have you maybe download a lot of data and requested a lot of DEM data in parallel?
Maybe you have been black-listed.
See also this thread: Snap connection to server
If the IP used by @matthewccasey accesing this forum is the same one used by SNAP when connecting to STEP server, then this IP is not banned by STEP server.
Thanks for looking at this. If it helps, to my knowledge, we ran SNAP on the same process only a couple of times yesterday. The first time it certainly worked and now it doesn’t.
In case it is a limit we’ve reached, I’ve re-checked access to https://download.esa.int/step/auxdata/dem/SRTM90/tiff/srtm_36_02.zip and that works via curl. (It also worked yesterday when I first encountered the problem.) So I think that implies we haven’t hit any limits.
In the logs, the only auxdata resources hit by your IP this week were some orbits and egm96 DEM.
There is no record for SRTM90 DEM access.
Therefore, at first sight, not a STEP server access issue.
Thanks. Odd, because I ran it certainly a couple of times yesterday (if not more) and today. Here’s an example from just now (also ran at least twice earlier today):
but no entries for SRTM90 DEM. Those requests are somehow not sent to STEP server by SNAP.
Also, in your log there are only errors regarding skywatch-auxdata bucket. In case of non-successful requests to STEP server, these errors would also appear in your log…
Hi @a2tirb
no, I have seen this problem too. But, lucky me, I don’t use it for any production. I just tested this functionality.
As I said earlier, @lveci is looking into this. Luis, can you give a status update?.
Thanks a lot! I think the exception that occurs when download fails is swallowed too and think that would be good to change in any case. I made a pull request.