A playback device may determine a quality measurement associated with one or more versions of a content fragment. The quality measurements may be based on one or more encoding characteristics associated with the plurality of versions of the content fragments. The quality measurements may be received by a content delivery system from the one or more devices and may be used by the content delivery system in determining a content playlist. By determining the quality measurements at the user device side, a larger number of quality measurements may be received and more accurate quality measurements may be utilized for determining the content playlist.