You are here

Open-Source: Attention-Based Neural Networks For Chroma Intra Prediction In Video Coding


Marc Gorriz Blanch, Saverio Blasi, Alan Smeaton, Noel O'Connor, Marta Mrak

Publication Type: 
Refereed Conference Meeting Proceeding
Neural networks can be successfully used to improve several modules of advanced video coding schemes. In particular, compression of colour components was shown to greatly benefit from usage of machine learning models, thanks to the design of appropriate attention-based architectures that allow the prediction to exploit specific samples in the reference region. However, such architectures tend to be complex and computationally intense, and may be difficult to deploy in a practical video coding pipeline. The software presented in this paper introduces a collection of simplifications to reduce the complexity overhead of the attention-based architectures. The simplified models are integrated into the Versatile Video Coding (VVC) prediction pipeline, retaining compression efficiency of previous chroma intra-prediction methods based on neural networks, while offering different directions for significantly reducing coding complexity.
Conference Name: 
2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)
Digital Object Identifer (DOI): 
Publication Date: 
Conference Location: 
Research Group: 
Dublin City University (DCU)
Open access repository: