US Patent 11386342 Model interpretation

Input data associated with a machine learning model is classified into a plurality of clusters. A plurality of linear surrogate models are generated. One of the plurality of linear surrogate models corresponds to one of the plurality of clusters. A linear surrogate model is configured to output a corresponding prediction based on input data associated with a corresponding cluster. Prediction data associated with the machine learning model and prediction data associated with the plurality of linear surrogate models are outputted.