US Patent 11609838 System to track and measure machine learning model efficacy

Systems and/or techniques for facilitating online-monitoring of machine learning models are provided. In various embodiments, a system can receive monitoring settings associated with a machine learning model to be monitored. In various cases, the monitoring settings can identify a first set of data features that are generated as output by the machine learning model. In various cases, the monitoring settings can identify a second set of data features that are received as input by the machine learning model. In various aspects, the system can compute a first set of statistical metrics based on the first set of data features. In various cases, the first set of statistical metrics can characterize a performance quality of the machine learning model. In various instances, the system can compute a second set of statistical metrics based on the second set of data features. In various cases, the second set of statistical metrics can characterize trends or distributions of input data associated with the machine learning model. In various aspects, the system can store the first set of statistical metrics and the second set of statistical metrics in a data warehouse that is accessible to an operator. In various embodiments, the system can render the first set of statistical metrics and the second set of statistical metrics on an electronic interface, such that the first set of statistical metrics and the second set of statistical metrics are viewable to the operator.