US Patent 11036994 Multi-modal object detection system with 5G array

A system may receive video data generated by a camera device positioned in a physical environment. The system may receive electromagnetic (EM) response signals generated by an array of 5G antenna devices. The system may refine the EM response signals. The system may determine location information for a metallic object. The system may generate a movement trajectory of the metallic object. The system may generate a feature vector comprising an aggregation of the refined EM response signals and the movement trajectory. The system may submit the feature vector to a machine learning framework. The system may classify the metallic object as a weapon. The system may generate a virtual render comprising a graphical indication of the metallic object. The system may combine the virtual render with the video input data and display the combined virtual render and video data.