Datasets
Standard Dataset
UGR'16 Tensor Time-Series Dataset
- Citation Author(s):
- Submitted by:
- Hongxiang Geng
- Last updated:
- Thu, 04/07/2022 - 22:17
- DOI:
- 10.21227/ma99-6j85
- Data Format:
- Links:
- License:
- Categories:
- Keywords:
Abstract
This dataset is used for network anomaly detection and is based on the UGR16 dataset network traffic flows. We used June week 2 to 4 tensors generated from raw flow data to train the models. The dataset includes a set of tensors generated from the whole UGR’16 network traffic (general tensor data) and several sets of port tensors (for specific port numbers). It also includes the trained models for each type of tensor. The tensors extracted from network traffic in the period from July week 5 to the end of August can be used for evaluation. The naming convention is as follows:
- Model: {week period}_{weekend or weekday}_{morning or evening}_{detection period}_{optional_port}_model
- Evaluation Tensors: {week number}_tensors_all_{detection period}_{optional port}
- Training Tensors: {week number}_tensors_{detection period}_{optional port}
After unzipping the model ZGIP file, it should contain a best_model.pt which can be loaded using Pytorch using the model structure defined in the model.py. The difference between training and evaluation tensors is that the training tensors only contain the traffic flows that are labelled as background while the evaluation tensors contain traffic labelled as background as well as different simulated attacks. For the port tensors, they use a different third dimension than the general tensor.
All the tensors in the dataset provided here are 3D 64 by 64 by 64 tensors. The dimensions for general tensors are source IP, destination IP, and destination port. The meaning of each index is defined at the beginning in util.py. The only thing that changed in the port tensors is the meaning of the third dimension which has changed from the destination port to the number of bytes. Similar to the general tensor, the indices of different dimensions of the port tensors are defined in util.py.
UGR'16 dataset is available at:
https://nesg.ugr.es/nesg-ugr16/
For the description of the UGR’16 dataset please see the following paper:
One GZIP file corresponds to one specific type of tensors used to either train or evaluates the model
Dataset Files
- august_week1_tensors_all_1min.tar.gz (138.52 MB)
- august_week1_tensors_all_1min_port53.tar.gz (52.36 MB)
- august_week1_tensors_all_10min_port25.tar.gz (6.58 MB)
- august_week1_tensors_all_10min_port6667.tar.gz (1.45 MB)
- august_week2_tensors_all_1min.tar.gz (139.09 MB)
- august_week2_tensors_all_1min_port53.tar.gz (52.76 MB)
- august_week2_tensors_all_10min_port25.tar.gz (6.84 MB)
- august_week2_tensors_all_10min_port6667.tar.gz (1.44 MB)
- august_week3_tensors_all_1min.tar.gz (139.05 MB)
- august_week3_tensors_all_1min_port53.tar.gz (53.55 MB)
- august_week3_tensors_all_10min_port25.tar.gz (7.84 MB)
- august_week3_tensors_all_10min_port6667.tar.gz (1.46 MB)
- august_week4_tensors_all_1min.tar.gz (144.42 MB)
- august_week4_tensors_all_1min_port53.tar.gz (56.31 MB)
- august_week4_tensors_all_10min_port25.tar.gz (7.56 MB)
- august_week4_tensors_all_10min_port6667.tar.gz (1.43 MB)
- august_week5_tensors_all_1min.tar.gz (7.44 MB)
- august_week5_tensors_all_1min_port53.tar.gz (2.82 MB)
- august_week5_tensors_all_10min_port25.tar.gz (306.09 kB)
- august_week5_tensors_all_10min_port6667.tar.gz (80.29 kB)
- july_week5_tensors_all_1min.tar.gz (86.84 MB)
- july_week5_tensors_all_1min_port53.tar.gz (33.52 MB)
- july_week5_tensors_all_10min_port25.tar.gz (4.56 MB)
- july_week5_tensors_all_10min_port6667.tar.gz (938.83 kB)
- july_week5_tensors_all_1min_port22.tar.gz (11.03 MB)
- july_week5_tensors_all_1min_port23.tar.gz (15.81 MB)
- july_week5_tensors_all_10min_port53413.tar.gz (1.87 MB)
- june_week_2to4_weekday_evening_1min_model.tar.gz (24.67 MB)
- june_week_2to4_weekday_evening_1min_port22_model.tar.gz (20.79 MB)
- june_week_2to4_weekday_evening_1min_port23_model.tar.gz (22.71 MB)
- june_week_2to4_weekday_evening_1min_port53_model.tar.gz (24.86 MB)
- june_week_2to4_weekday_evening_10min_port25_model.tar.gz (25.47 MB)
- june_week_2to4_weekday_evening_10min_port6667_model.tar.gz (20.16 MB)
- june_week_2to4_weekday_evening_10min_port53413_model.tar.gz (23.05 MB)
- june_week_2to4_weekday_morning_1min_model.tar.gz (24.35 MB)
- june_week_2to4_weekday_morning_1min_port22_model.tar.gz (20.02 MB)
- june_week_2to4_weekday_morning_1min_port23_model.tar.gz (23.19 MB)
- june_week_2to4_weekday_morning_1min_port53_model.tar.gz (25.22 MB)
- june_week_2to4_weekday_morning_10min_port25_model.tar.gz (23.03 MB)
- june_week_2to4_weekday_morning_10min_port6667_model.tar.gz (18.49 MB)
- june_week_2to4_weekday_morning_10min_port53413_model.tar.gz (18.46 MB)
- june_week_2to4_weekend_evening_1min_model.tar.gz (21.22 MB)
- june_week_2to4_weekend_evening_1min_port22_model.tar.gz (24.78 MB)
- june_week_2to4_weekend_evening_1min_port23_model.tar.gz (24.34 MB)
- june_week_2to4_weekend_evening_1min_port53_model.tar.gz (25.10 MB)
- june_week_2to4_weekend_evening_10min_port25_model.tar.gz (24.32 MB)
- june_week_2to4_weekend_evening_10min_port6667_model.tar.gz (23.37 MB)
- june_week_2to4_weekend_evening_10min_port53413_model.tar.gz (22.79 MB)
- june_week_2to4_weekend_morning_1min_model.tar.gz (24.81 MB)
- june_week_2to4_weekend_morning_1min_port22_model.tar.gz (23.72 MB)
- june_week_2to4_weekend_morning_1min_port23_model.tar.gz (24.52 MB)
- june_week_2to4_weekend_morning_1min_port53_model.tar.gz (21.23 MB)
- june_week_2to4_weekend_morning_10min_port25_model.tar.gz (23.36 MB)
- june_week_2to4_weekend_morning_10min_port6667_model.tar.gz (18.86 MB)
- june_week_2to4_weekend_morning_10min_port53413_model.tar.gz (21.81 MB)
- june_week2_tensors_1min.tar.gz (133.85 MB)
- june_week3_tensors_1min.tar.gz (132.71 MB)
- june_week4_tensors_1min.tar.gz (128.84 MB)
- june_week2_tensors_1min_port22.tar.gz (17.55 MB)
- june_week3_tensors_1min_port22.tar.gz (17.72 MB)
- june_week4_tensors_1min_port22.tar.gz (16.98 MB)
- june_week2_tensors_1min_port23.tar.gz (25.82 MB)
- june_week3_tensors_1min_port23.tar.gz (24.94 MB)
- june_week4_tensors_1min_port23.tar.gz (25.08 MB)
- june_week2_tensors_1min_port53.tar.gz (52.87 MB)
- june_week3_tensors_1min_port53.tar.gz (51.86 MB)
- june_week4_tensors_1min_port53.tar.gz (51.22 MB)
- june_week2_tensors_10min_port25.tar.gz (64.16 MB)
- june_week3_tensors_10min_port25.tar.gz (62.00 MB)
- june_week4_tensors_10min_port25.tar.gz (61.61 MB)
- june_week2_tensors_10min_port6667.tar.gz (15.54 MB)
- june_week3_tensors_10min_port6667.tar.gz (14.81 MB)
- june_week4_tensors_10min_port6667.tar.gz (13.76 MB)
- june_week2_tensors_10min_port53413.tar.gz (16.44 MB)
- june_week3_tensors_10min_port53413.tar.gz (16.47 MB)
- june_week4_tensors_10min_port53413.tar.gz (15.51 MB)
- model.py (1.07 kB)
- util.py (14.36 kB)