US Patent 11294388 Machine learning enhanced vehicle merging

A method receives a first image set depicting a merging zone, the first image set including first image(s) associated with a first timestamp; determines, using a trained first machine learning logic, a first state describing a traffic condition of the merging zone at the first timestamp using the first image set; determines, from a sequence of states describing the traffic condition of the merging zone at a sequence of timestamps, using a trained second machine learning logic, second state(s) associated with second timestamp(s) prior to the first timestamp of the first state using a trained backward time distance; computes, using a trained third machine learning logic, impact metric(s) for merging action(s) using the first state, the second state(s), and the merging action(s); selects, from the merging action(s), a first merging action based on the impact metric(s); and provides a merging instruction including the first merging action to a merging vehicle.