US Patent 10481948 Data transfer in a collaborative file sharing system

A system and method for facilitating implementing a computing task (such as selectively transforming and/or writing data retrieved from a message stream of a message broker) via concurrent computing in a networked computing environment. The example method includes using a distributed software framework to encapsulate overhead functionality for facilitating extracting data from a data stream output from the message broker and writing associated data to one or more targets in a networked computing environment; and accommodating custom code as a plugin to one or more modules of the software framework. In a more specific embodiment, the one or more modules include one or more committers. The overhead functionality includes functionality for facilitating selective redistribution of work when a process becomes unreliable; tracking of offsets for message batches in the data stream; automatically assigning work to nodes in the networked computing environment.