Having one of their hands taken gives Phalanx an excuse to not look at the strange man and worry over strange thoughts anymore. They look down at that point of contact and let go of some other things, continuing to listen to the interaction but not as part of it.