US Patent 10395144 Deeply integrated fusion architecture for automated driving systems

Methods and apparatus are provided for controlling an autonomous vehicle. A sensor fusion system with a sensor system for providing environment condition information and a convolutional neural network (CNN) is provided. The CNN includes a receiving interface configured to receive the environment condition information from the sensor system, a common convolutional layer configured to extract traffic information from the received environment condition information, and a plurality of fully connected layers configured to detect objects belonging to different object classes based on the extracted traffic information, wherein the object classes include at least one of a road feature class, a static object class, and a dynamic object class.