A hitch pin assembly for securing a shank member to a hitch receiver tube to minimize relative motion between the shank member and receiver tube, comprising an elongated pin having a threaded portion, a threaded nut, an elastomer piece, and a shank member which are mated for tightened engagement compressing the elastomer piece so as to firmly engage the receiver tube. The shank member may include a slot for a corresponding threaded nut and elastomer piece so when the pin is tightened, the nut compresses the elastomer against the interior wall of the shank surface and upwardly, thereby restraining movement of the threaded nut and dampening movement of the shank inside the hitch receiver tube.