US Patent 10148548 System and method for real-time analysis of incoming data

The inventive system processes large quantities of client data. The inventive system can include an inbound message gateway (IMG) which receives event data from a plurality of clients. The IMG performs one or more processes on the event data and transmits sample data streams to an analytics cluster that includes a plurality of physical hardware nodes. Each of the physical hardware nodes can include a plurality of processes at a plurality of different time granularities. Database shards store recorded data from each of the processes in the physical nodes.