The present invention extends to methods, systems, and computer program products for detecting events from ingested data streams. A data stream is ingested. A first score is computed from a portion of the data stream. The first score indicates a likelihood of the video stream including event information. Computing resources are allocated to further process the data stream portion based on the first score indicating that further processing is warranted. A second score is computed from parameters of the data stream portion. An event is detected based on the second score.