You are here

The Impact of Temporal Regularisation in Egocentric Saliency Prediction

Authors: 

Linardos Panagiotis, Eva Mohedano, Monica Cherto, Cathal Gurrin, Xavier Giro-i-Nieto

Publication Type: 
Refereed Conference Meeting Proceeding
Abstract: 
This work explores how temporal regularization in egocentric videos may have a positive or negative impact in saliency prediction depending on the viewer behavior. Our study is based on the new EgoMon dataset, which consists of seven videos recorded by three subjects in both free-viewing and task-driven set ups. We predict a frame-based saliency prediction over the frames of each video clip, as well as a temporally regularized version based on deep neural networks. Our results indicate that the NSS saliency metric improves during task-driven activities, but that it clearly drops during free-viewing. Encouraged by the good results in task-driven activities, we also computed and publish the saliency maps for the EPIC Kitchens dataset.
Conference Name: 
2018 3rd International Workshop on Egocentric Perception, Interaction and Computing (ECCV)
Digital Object Identifer (DOI): 
10.22678
Publication Date: 
09/09/2018
Conference Location: 
Germany
Research Group: 
Institution: 
Dublin City University (DCU)
Open access repository: 
Yes