As you can only use one polarization for interferometry, at a time, you can run the band-select operator to reduce the dual-polarized data also HH. Maybe the pattern of the HV-band somehow disturbs the coregistration process.
Another thing to try would be Deskewing after Coregistration.