Calculate Backscatter coefficient by SNAP

the only thing I can think of is to use digital elevation models of higher spatial resolution and quality.

Regarding your second question, you need Beta0 as an input for Terrain Flattening - please have a look here: