Random patches on displacement image

[nbowen]

I’ve created a number of displacement maps but each of them have random patches of values (blue line to the left and black triangle). Does anyone know how to get rid of these?

Thanks!

[nbowen]

Here’s another example…