Factorizing time-aware multi-way tensors for enhancing semantic wearable sensing
Refereed Conference Meeting Proceeding
Automatic concept detection is a crucial aspect of automatically indexing unstructured multimedia archives. However, the current prevalence of one-per-class detectors neglect inherent concept relation- ships and operate in isolation. This is insufficient when analyzing content gathered from wearable visual sensing, in which concepts occur with high diversity and with correlation depending on context. This paper presents a method to enhance concept detection results by constructing and factorizing a multi-way concept detection tensor in a time-aware manner. We derived a weighted non-negative tensor factorization algorithm and applied it to model concepts’ temporal occurrence patterns and show how it boosts overall detection performance. The potential of our method is demonstrated on lifelog datasets with varying levels of original concept detection accuracies.
21st International Conference on Multimedia Modelling (MMM 2015)
MMM 2015. Lecture Notes in Computer Science 8. Springer. ISBN 978-3-319-14442-9
Digital Object Identifer (DOI):
Dublin City University (DCU)
Open access repository: