A fluid dispenser formed of a bottle for housing the fluid, a discharge mechanism for discharging fluid from the bottle, and a protrusion that is connected to and extends from the bottom of the bottle. The fluid dispenser may have a fastener and a stabilizer. The protrusion has a diameter that is smaller than the diameter of the bottom wall of the bottle. The bottle is capable of standing upward on a horizontal surface without the use of a separate base or mount when the protrusion extends into an aperture in the horizontal surface such that the bottom wall of the bottle rests on the horizontal surface. Further, a method of installing a fluid dispenser.