Dynamic Low-Latency Distributed Event Processing of Sensor Data Streams

Abstract

Event-based systems (EBS) are used to detect meaningful events with low latency in surveillance sports finances etc. Howeverwith rising data and event rates and with correlations among these events processing can no longer be sequential but it needs to be distributed. However naively distributing existing approaches not only cause failures as their order-less processing of events cannot deal with the ubiquity of out-of-order event arrival. It is also hard to achieve a minimal detection latency. This paper illustrates the combination of our building blocks towards a scalable pub- lish/subscribe-based EBS that analyzes high data rate sensor streams with low latency: a parameter calibration to put out-of-order events in order without a-priori knowledge on event delaysa runtime migration of event detectors across system resourcesand an online optimization algorithm that uses migration to improve performance. We evaluate our EBS and its building blocks on position data streams from a Realtime Locating System in a sports application.