A cover plate for an electrical outlet or electrical switch unit includes an attachment element having one surface attached to an inside surface of the cover plate and another surface configured to be removably secured to a surface of the outlet or switch unit. Advantageously, this attachment method of the cover plate onto the outlet or switch unit conceals unsightly screws. In one embodiment, the attachment element comprises magnets to connect the cover plate to the outlet or switch unit. In another embodiment, mating VELCRO™ portions are used to connect the cover plate to the outlet or switch unit.