The Waterloo Streaming Quality-of-Experience Database-IV

Citation Author(s):
Zhengfang
Duanmu
University of Waterloo
Wentao
Liu
University of Waterloo
Zhuoran
Li
University of Waterloo
Diqi
Chen
Peking University
Zhou
Wang
University of Waterloo
Yizhou
Wang
Peking University
Wen
Gao
Peking University
Submitted by:
Zhuoran Li
Last updated:
Wed, 05/17/2023 - 20:59
DOI:
10.21227/j15a-8r35
Data Format:
Links:
License:
0
0 ratings - Please login to submit your rating.

Abstract 

The diversity of video delivery pipeline poses a grand challenge to the evaluation of adaptive bitrate (ABR) streaming algorithms and objective quality-of-experience (QoE) models.

Here we introduce so-far the largest subject-rated database of its kind, namely WaterlooSQoE-IV, consisting of 1350 adaptive streaming videos created from diverse source contents, video encoders, network traces, ABR algorithms, and viewing devices.

We collect human opinions for each video with a series of carefully designed subjective experiments.

Subsequent data analysis and testing/comparison of ABR algorithms and QoE models using the database lead to a series of novel observations and interesting findings, in terms of the effectiveness of subjective experiment methodologies, the interactions between user experience and source content, viewing device and encoder type, the heterogeneities in the bias and preference of user experiences, the behaviors of ABR algorithms, and the performance of objective QoE models.

Instructions: 

The Waterloo Quality-of-Experience IV database consists of 1,350 streaming videos (generated from 5 source videos x 2 encoders x 9 network traces x 5 ABR algorithms x 3 viewing devices). The 5 ABR algorithms include RB, BB, FastMPC, Pensieve, and RDOS.

The waterloo_sqoe4_feature.zip contains all meta data such as chunk level bitrate, rebuffering duration, spatial resolution, and MOS.

The waterloo_sqoe4_server_video.zip contains the dash videos on the server.

The waterloo_sqoe4_full.zip contains all the streaming videos in mp4.

Comments

Good dataset!

Submitted by Tianchi Huang on Mon, 02/22/2021 - 11:27

Could you please provide the complete link instead of s3://ieee-dataport.org/?

Submitted by Jianqiang Wang on Thu, 12/02/2021 - 00:18

HI, I have downloaded the full dataset, including videos and the MOS database.
Currently I'm in mainland China, feel free to let me know if you have any requirements.
My email is htc19 at mails.tsinghua.edu.cn

Submitted by Tianchi Huang on Thu, 12/02/2021 - 00:37

Thank you for reporting the problem, the "Access on AWS" page doesn't provide the correct s3 link. Please use the link "s3://ieee-dataport/open/35885/waterloo_sqoe4_full.zip" to access the dataset.

Submitted by Zhuoran Li on Thu, 12/02/2021 - 10:18

Please use aws cli or other aws supported downloader to download the dataset.

Submitted by Zhuoran Li on Tue, 07/19/2022 - 13:28

aws cli shows "fatal error: An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Access Denied”. Is there any solution?

Submitted by Zhiheng Zhou on Thu, 04/20/2023 - 23:26