great to see it (technically) worked.
About the displacement pattern: As it is highly regular there must be some bias in it. I would try it with another image pair, maybe with a smaller time increment and see if there are differences.
By the way: Did you use “Phase to elevation” or “Phase to displacement”? Because the latter is important for your case and the screenshot says “slant2h” and I was just wondering.