ZUT-FIR-ADAS

ZUT-FIR-ADAS

Citation Author(s):
Paulius
Tumas
Adam
Nowosielski
Artūras
Serackis
Submitted by:
Paulius Tumas
Last updated:
Wed, 01/22/2020 - 18:00
DOI:
10.21227/7f37-hx89
License:
Dataset Views:
111
Rating:
0
0 ratings - Please login to submit your rating.
Share / Embed Cite

Pedestrian detection has never been an easy task for computer vision and automotive industry. Systems like the advanced driver assistance system (ADAS) highly rely on far infrared (FIR) data captured to detect pedestrians at nighttime. The recent development of deep learning-based detectors has proven the excellent results of pedestrian detection in perfect weather conditions. However, it is still unknown what is the performance in adverse weather conditions. In this paper, it is introduced a 16bit thermal data dataset called ZUT (Zachodniopomorski Uniwersytet Technologiczny) having the most extensive variety of fine-grained annotated images captured in 4 biggest European Union countries captured during severe weather conditions. In addition to this, we also provide a synchronized Controller Area Network (CAN) bus data, including driving speed, brake pedal status, and outside temperature for future ADAS system development. Furthermore, we have tested and provided 16-bit depth modifications for Yolov3 deep neural network (DNN) based detector reaching mean Average Precision (mAP) up to 89.1%.

Instructions: 

Prefix _b - means benchmark, otherwise used for training/testing

 

Each recording folder contains:

  16BitFrames - 16bit original capture without processing.

  16BitTransformed - 16bit capture with low pass filter applied and scaled to 640x480.

  annotations - annotations and 8bit images made from 16BitTransformed.

  carParams.csv - a CAN details with coresponding frame ID.

  weather.txt - weather information in which the recording was made.

 

Annotations are made in YOLO (You only look once) Darknet format.

 

To have images without low pass filter applied you should make the following steps:

- Take 16bit images from 16BitFrames folder and open with OpenCV function like: Mat input = imread(<image_full_path>, -1);

- Then use convertTo function like: input.convertTo(output, input.depth(), sc, sh), where output is transformed Mat, sc is scale and sh is shift from carParams.csv file.

- Finally, scale image to 640x480 

Dataset Files

You must login with an IEEE Account to access these files. IEEE Accounts are FREE.

Sign Up now or login.

Documentation

AttachmentSize
Plain text icon Classes111 bytes
Plain text icon readme.txt929 bytes

Embed this dataset on another website

Copy and paste the HTML code below to embed your dataset:

Share via email or social media

Click the buttons below:

facebooktwittermailshare
[1] Paulius Tumas, Adam Nowosielski, Artūras Serackis, "ZUT-FIR-ADAS", IEEE Dataport, 2020. [Online]. Available: http://dx.doi.org/10.21227/7f37-hx89. Accessed: Feb. 28, 2020.
@data{7f37-hx89-20,
doi = {10.21227/7f37-hx89},
url = {http://dx.doi.org/10.21227/7f37-hx89},
author = {Paulius Tumas; Adam Nowosielski; Artūras Serackis },
publisher = {IEEE Dataport},
title = {ZUT-FIR-ADAS},
year = {2020} }
TY - DATA
T1 - ZUT-FIR-ADAS
AU - Paulius Tumas; Adam Nowosielski; Artūras Serackis
PY - 2020
PB - IEEE Dataport
UR - 10.21227/7f37-hx89
ER -
Paulius Tumas, Adam Nowosielski, Artūras Serackis. (2020). ZUT-FIR-ADAS. IEEE Dataport. http://dx.doi.org/10.21227/7f37-hx89
Paulius Tumas, Adam Nowosielski, Artūras Serackis, 2020. ZUT-FIR-ADAS. Available at: http://dx.doi.org/10.21227/7f37-hx89.
Paulius Tumas, Adam Nowosielski, Artūras Serackis. (2020). "ZUT-FIR-ADAS." Web.
1. Paulius Tumas, Adam Nowosielski, Artūras Serackis. ZUT-FIR-ADAS [Internet]. IEEE Dataport; 2020. Available from : http://dx.doi.org/10.21227/7f37-hx89
Paulius Tumas, Adam Nowosielski, Artūras Serackis. "ZUT-FIR-ADAS." doi: 10.21227/7f37-hx89