Multi-Modal And Multi-Sensor Approach To Support Security Management Tasks

Recent changes in the dynamic characteristics of security and emergency management requirements have a big impact on the development of more effective security systems. Innovative solutions have to provide support for new security challenges and newly developed operational strategies. Widely used security concepts based on video sensor solutions are being replaced by high-performance multi-sensor systems, which allow monitoring of outdoor areas with various sizes independent of lighting and weather conditions. Apart from the sensors used, the system effectiveness depends on innovative automatic data analysis including AI methods to enable generation of a comprehensive near real-time representation of a given situation.This work describes a concept and an experimental prototype of a self-sufficient, independent multi-sensor system for monitoring of critical personal behavior in the context of events, border area surveillance and critical infrastructure monitoring. The specific security scenarios were defined and worked out in detail in close cooperation with security experts. In order to ensure 24/7 operational capability, the work focuses on a flexible sensor platform concept and includes optical, thermal and radar sensors which are synergistically employed. Furthermore, innovative approaches to multi-sensor Al-based data analysis and web-based mobile information management solutions were developed as part of the nationally funded research project WatchDog to enable a targeted, scenario oriented support of the security forces.