Attentional multimodal interface for multidrone search in the Alps

We present a multimodal attentional interface suitable for a human operator that monitors and controls the activities of a team of drones during search and rescue missions. We consider a scenario where the operator is a component of the rescue team, hence not fully dedicated to the robots, but only able to interact with them with sparse and incomplete commands. In this context, an adaptive interface is needed to support the user situation awareness and to enable an effective interaction with the drones. In this work, we propose a multimodal attention-based interface designed for this domain. This framework is to filter the information flow towards the operator selecting and adapting the communication mode according to the context and the human state. We illustrate the features of the adaptive system along with an initial assessment in a simulated scenario.