The interferometric phase you calculate has many contributions like : phase related to “flat earth” , displacement, topography, atmoshpere and noise. If you want to retrieve from your interferogram only the deformation you need to remove all the other phase components. Sometimes we can neglect some components but in general case if you want to retrieve deformation you need to remove the component related to topography.