You are here

Open-Source: Attention-Based Neural Networks For Chroma Intra Prediction In Video Coding

Authors: 

Marc Gorriz Blanch, Saverio Blasi, Alan Smeaton, Noel O'Connor, Marta Mrak

Publication Type: 
Refereed Conference Meeting Proceeding
Abstract: 
Neural networks can be successfully used to improve several modules of advanced video coding schemes. In particular, compression of colour components was shown to greatly benefit from usage of machine learning models, thanks to the design of appropriate attention-based architectures that allow the prediction to exploit specific samples in the reference region. However, such architectures tend to be complex and computationally intense, and may be difficult to deploy in a practical video coding pipeline. The software presented in this paper introduces a collection of simplifications to reduce the complexity overhead of the attention-based architectures. The simplified models are integrated into the Versatile Video Coding (VVC) prediction pipeline, retaining compression efficiency of previous chroma intra-prediction methods based on neural networks, while offering different directions for significantly reducing coding complexity.
Conference Name: 
2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)
Digital Object Identifer (DOI): 
10.1109/ICMEW53276.2021.9455958
Publication Date: 
09/07/2021
Conference Location: 
China
Research Group: 
Institution: 
Dublin City University (DCU)
Open access repository: 
Yes