Comparing VVC, HEVC and AV1 using Objective and Subjective Assessments

Mariana Afonso

Goce Dimitrov

University of Bristol

About

In this project, the performance of three state-of-the-art video codecs: High Efficiency Video Coding (HEVC) Test Model (HM), AOMedia Video 1 (AV1) and Versatile Video Coding Test Model (VTM), are evaluated using both objective and subjective quality assessments. Nine source sequences were carefully selected to offer both diversity and representativeness, and different resolution versions were encoded by all three codecs at pre-defined target bitrates. The compression efficiency of the three codecs are evaluated using two commonly used objective quality metrics, PSNR and VMAF. The subjective quality of their reconstructed content is also evaluated through psychophysical experiments. Furthermore, HEVC and AV1 are compared within a dynamic optimization framework (convex hull rate-distortion optimization) across resolutions with a wider bitrate, using both objective and subjective evaluations. Finally the computational complexities of three tested codecs are compared. The subjective assessments indicate that, for the tested versions there is no significant difference between AV1 and HM, while the tested VTM version shows significant enhancements. The selected source sequences, compressed video content and associated subjective data are available online, offering a resource for compression performance evaluation and objective video quality assessment.

Useful Links

[DOWNLOAD] all videos from data.bris

[DOWNLOAD] subjective data.


Citation

@inproceedings{katsenou2019subjective,
  title={A subjective comparison of AV1 and HEVC for adaptive video streaming},
  author={Katsenou, Angeliki V and Zhang, Fan and Afonso, Mariana and Bull, David R},
  booktitle={2019 IEEE International Conference on Image Processing (ICIP)},
  pages={4145--4149},
  year={2019},
  organization={IEEE}
}[paper]

@article{zhang2020comparing,
  title={Comparing VVC, HEVC and AV1 using objective and subjective assessments},
  author={Zhang, Fan and Katsenou, Angeliki V and Afonso, Mariana and Dimitrov, Goce and Bull, David R},
  journal={arXiv preprint arXiv:2003.10282},
  year={2020}
}[paper]