A battery retaining system for a portable oxygen concentrator includes a first rail configured to receive a first slide of a battery, a second rail configured to receive a second slide of the battery, the second rail being spaced apart from the first rail so as to form a channel configured to receive the battery, and a flexible stiffening mechanism configured to impart a biasing force on a surface of the battery when the battery is received within the channel. The flexible stiffening mechanism includes a protrusion projecting from the first rail at least partially towards the second rail and a slit positioned behind the protrusion and configured to facilitate travel of the protrusion fore and aft.