Caps or cap-like covers adapted to be secured in position by permanent deformation of the wall-engaging parts made of metallic foil or like thin flexible material