Your coherence doesn’t seem very high. I doubt that the observed displacement patterns result from usable phase information. Have you tried masking out values below 0.3 and see what is left? (see the approach here: Subsidence map in 3d view - #19 by ABraun)
Do you have much vegetation in your study area? Maybe you should also look for a shorter temporal baseline: