Zero-shot event detection via event-adaptive concept relevance mining

Zero-shot complex event detection has been an emerging task in coping with the scarcity of labeled training videos in practice. Aiming to progress beyond the state-of-the-art zero-shot event detection, we propose a new zero-shot event detection approach, which exploits the semantic correlation between an event and concepts. Based on the concept detectors pre-trained from external sources, our method learns the semantic correlation from the concept vocabulary and emphasizes on the most related concepts for the zero-shot event detection. Particularly, a novel Event-Adaptive Concept Integration algorithm is introduced to estimate the effectiveness of semantically related concepts by assigning different weights to them. As opposed to assigning weights by an invariable strategy, we compute the weights of concepts using the area under score curve. The assigned weights are incorporated into the confidence score vector statistically to better characterize the event-concept correlation. Our algorithm is proved to be able to harness the related concepts discriminatively tailored for a target event. Extensive experiments are conducted on the challenging TRECVID event video datasets, which demonstrate the advantage of our approach over the state-of-the-art methods.