US Patent 11501211 Chatbot system with model lifecycle management

The present disclosure describes methods, devices, and non-transitory computer readable storage medium for managing lifecycle of a knowledge base (KB) in chatbot systems. The method includes receiving an update request and updating a current-version KB as a new current-version KB. The method also includes receiving a first test request from a knowledge point (KP) operator and determining whether the new current-version KB passes a first test; and in response to the determination that the new current-version KB passes the first test, submitting the new current-version KB as a new submit-version KB. The method further includes receiving a second test request from a KP manager and determining whether the new submit-version KB passes a second test; and in response to the determination that the new submit-version KB passes the second test, storing an original production-version KB as a pervious-version KB and submitting the new submit-version KB as a new production-version KB.