Theory: Image Based Height Map for Hole-Filling

Problem:
Filling irregularly shaped holes with appropriately continuous geometry, as in scan data with non-circular holes.

Possible Solution:
create an arbitrary height map for a patch that encompases the hole and then using 2d imaging techniques "build" a new height map for the empty area.

As a manual technique, one could literally blur-paint from the edges, using human feature recognition. but I believe that, using gaussian blurring techniques it should be quite possible to build a relatively pleasing result in an automated way.

Test:
import scan data with big patchy holes into maya.
create a texture map/placement
generate height-map data using the transfer attributes function
open height map data in photoshop, and using various techniques, blend/blur/paint/smear... create a new height map that fills in the gaps
import new map into maya, and using a displacement node, build a new mesh that fills in the gaps.
trim the edges to match scan data, then bridge the gap.

I haven't tried it yet, but still planning to.