About putting back the dropping hat or other character-related accessories, it is like keeping the legitimate shape to the character; yet it might be considered an awkward move during the scene.
In other words, if the scene is about some smooth processes or packs of violent, fast-pace actions, would a dropped accessory bother one?

Perhaps it is a director-preference question.