Patent attributes
A computer-implemented method includes assigning an auditor weight to each user of a plurality of users. A plurality of audit data is received from the plurality of users, where each audit data is associated with a respective user and includes a set of user ratings for an audit. Final ratings are generated for the audit, with a respective final rating for each item in the audit. Generating the final rating of a first item in the audit includes identifying, in the audit data, user ratings for the first item. The user ratings for the first item include a respective user rating of the first item from each user. Generating the final rating of a first item further includes calculating the final rating of the first item based on a weighted combination of the plurality of user ratings for the first item, according to the respective auditor weight of each user.