A fixing device includes: a fixing unit that irradiates light to a color material transferred to a medium at a position specified by image data, to fix the color material on the medium; and a control unit that controls irradiation of light of the fixing unit so that an energy of light irradiated to an image-forming area on the medium including an area in which the color material has been transferred at the position specified by the image data is lower than an energy of light irradiated to a non image-forming area on the medium other than the image-forming area.