this has been reported and discussed several times, please have a look at these posts:
- S2 export into tiff - NaturalRGB or Falso color infrared RGB
- S1 TOPS Coregistration error - Java heap space error?
- Problem creating image from a band
Basically, your computer does not have enough memory to process the operation or cannot provide it to SNAP.