facebooktwittermailshare

VideoSet

Abstract: 

A new methodology to measure coded image/video quality using the just-noticeable-difference (JND) idea was proposed in [1].  Several small JND-based image/video quality datasets were released by the Media Communications Lab at the University of Southern California in [2, 3]. In this work, we present an effort to build a large-scale JND-based coded video quality dataset. The dataset consists of 220 5-second sequences in four resolutions (i.e., 1920x1080, 1280x720, 960x540, and 640x 360).  For each of the 880 video clips, we encode it using the H.264 codec with QP=1, ..., 51 and measure the first three JND points with 30+ subjects.  The dataset is called the ``VideoSet", which is an acronym for ``Video Subject Evaluation Test (SET)". This work describes the subjective test procedure, detection and removal of outlying measured data, and the properties of collected JND data. Finally, the significance and implications of the VideoSet to future video coding research and standardization efforts are pointed out. All source/coded video clips as well as measured JND data included in the VideoSet are available to the public here.

 
[1] Joe Yuchieh Lin, et al., Experimental design and analysis of JND test on coded image/video. Proc. SPIE, Applications of Digital Image Processing XXXVIII, September 22, 2015.
 
[2] L. Jin, et al., Statistical study on perceived JPEG image quality via MCL- JCI dataset construction and analysis, in: IS&T/SPIE Electronic Imaging, International Society for Optics and Photonics, 2016.
 
[3] H. Wang, et al., MCL-JCV: A JND-based H.264/AVC video quality assessment dataset, in: 2016 IEEE International Conference on Image Processing (ICIP), 2016, pp. 1509–1513.

 

Update:

  • As requested by some users, we prepared a copy of videoSet hosted on BaiduYun. Please try both servers, i.e. AWS in this page and BaiduYun and find the one that works better for you. Date: 02/14/2017.
  • A typo fixed. The second header in 960x540_1st.csv, changed from anchor to jnd. Date: 03/01/2017
  • Citation was updated in README_V2. The dataset paper was accepted by JVCIR and PDF attached. Date: 05/09/2017.

 

Instructions: 

Please refer to README.md for more details. It is available at the bottom right corner of this page.

Submit an Analysis

Dataset Files

You must be an IEEE Dataport Subscriber to access these files. Subscribe now or login.

Help us make IEEE DataPort better. Sign up to be a Beta Tester and receive a coupon code for a free subscription to IEEE DataPort! Learn More

Dataset Details

Citation Author(s):
Haiqiang Wang, Ioannis Katsavounidis, Xin Zhou, Jiwu Huang, Man-On Pun, Xin Jin, Ronggang Wang, Xu Wang, Yun Zhang, Jeonghoon Park, Jiantong Zhou, Shawmin Lei, Sam Kwong, and C.-C. Jay Kuo
Submitted by:
Haiqiang wang
Last updated:
Tue, 05/09/2017 - 14:15
DOI:
10.21227/H2H01C
Data Format:
Links:
 
Cite

Documentation

AttachmentSize
Binary Data README_V2.md5.4 KB
PDF icon videoset_jvcir.pdf2.06 MB

Subscribe

[1] Haiqiang Wang, Ioannis Katsavounidis, Xin Zhou, Jiwu Huang, Man-On Pun, Xin Jin, Ronggang Wang, Xu Wang, Yun Zhang, Jeonghoon Park, Jiantong Zhou, Shawmin Lei, Sam Kwong, and C.-C. Jay Kuo, "VideoSet", IEEE Dataport, 2016. [Online]. Available: http://dx.doi.org/10.21227/H2H01C. Accessed: Aug. 20, 2017.
@data{h2h01c-16,
doi = {10.21227/H2H01C},
url = {http://dx.doi.org/10.21227/H2H01C},
author = {Haiqiang Wang; Ioannis Katsavounidis; Xin Zhou; Jiwu Huang; Man-On Pun; Xin Jin; Ronggang Wang; Xu Wang; Yun Zhang; Jeonghoon Park; Jiantong Zhou; Shawmin Lei; Sam Kwong; and C.-C. Jay Kuo },
publisher = {IEEE Dataport},
title = {VideoSet},
year = {2016} }
TY - DATA
T1 - VideoSet
AU - Haiqiang Wang; Ioannis Katsavounidis; Xin Zhou; Jiwu Huang; Man-On Pun; Xin Jin; Ronggang Wang; Xu Wang; Yun Zhang; Jeonghoon Park; Jiantong Zhou; Shawmin Lei; Sam Kwong; and C.-C. Jay Kuo
PY - 2016
PB - IEEE Dataport
UR - 10.21227/H2H01C
ER -
Haiqiang Wang, Ioannis Katsavounidis, Xin Zhou, Jiwu Huang, Man-On Pun, Xin Jin, Ronggang Wang, Xu Wang, Yun Zhang, Jeonghoon Park, Jiantong Zhou, Shawmin Lei, Sam Kwong, and C.-C. Jay Kuo. (2016). VideoSet. IEEE Dataport. http://dx.doi.org/10.21227/H2H01C
Haiqiang Wang, Ioannis Katsavounidis, Xin Zhou, Jiwu Huang, Man-On Pun, Xin Jin, Ronggang Wang, Xu Wang, Yun Zhang, Jeonghoon Park, Jiantong Zhou, Shawmin Lei, Sam Kwong, and C.-C. Jay Kuo, 2016. VideoSet. Available at: http://dx.doi.org/10.21227/H2H01C.
Haiqiang Wang, Ioannis Katsavounidis, Xin Zhou, Jiwu Huang, Man-On Pun, Xin Jin, Ronggang Wang, Xu Wang, Yun Zhang, Jeonghoon Park, Jiantong Zhou, Shawmin Lei, Sam Kwong, and C.-C. Jay Kuo. (2016). "VideoSet." Web.
1. Haiqiang Wang, Ioannis Katsavounidis, Xin Zhou, Jiwu Huang, Man-On Pun, Xin Jin, Ronggang Wang, Xu Wang, Yun Zhang, Jeonghoon Park, Jiantong Zhou, Shawmin Lei, Sam Kwong, and C.-C. Jay Kuo. VideoSet [Internet]. IEEE Dataport; 2016. Available from : http://dx.doi.org/10.21227/H2H01C
Haiqiang Wang, Ioannis Katsavounidis, Xin Zhou, Jiwu Huang, Man-On Pun, Xin Jin, Ronggang Wang, Xu Wang, Yun Zhang, Jeonghoon Park, Jiantong Zhou, Shawmin Lei, Sam Kwong, and C.-C. Jay Kuo. "VideoSet." doi: 10.21227/H2H01C