interferogram averaging is basically a great idea (please also see here).
In terms of differential Interferometry, different image pairs may produce different subsidence values if the subsidence is not consistent over time. So by averaging you would loose those temporal variations but maybe get a clearer overall interferogram.