US Patent 10503748 ELT management service with publish/subscribe architecture

An extract, load, and transform (ELT) management service provides functionality for managing ELT operations, including publish/subscribe functionality. The ELT management service maintains metadata describing publications, such as database tables or files stored by a storage service operating in a service provider network, and publication certificates, which describe the creation and change history for the publications. The metadata can be searched to identify publications that rely on other publications that have changed since the publications were generated. The identified publications can then be automatically republished by executing logical pipelines that specify activities that can be executed to republish the publications.