Ingestion and reporting times for processing 5G performance management files in a Big Data framework

Citation Author(s):
Diana
Martinez-Mosquera
Submitted by:
Diana Mosquera
Last updated:
Tue, 05/17/2022 - 22:17
DOI:
10.21227/7087-m428
Data Format:
Research Article Link:
License:
0
0 ratings - Please login to submit your rating.

Abstract 

This dataset presents the results obtained for Ingestion and Reporting layers of a Big Data architecture for processing performance management (PM) files in a mobile network. Flume was used in the Ingestion layer. Flume collected PM files from a virtual machine that replicates PM files from a 5G network element (gNodeB). Flume transferred PM files to High Distributed File System (HDFS) in XML format. Hive was used in the Reporting layer. Hive queries the raw data from HDFS. Hive queries a view from HDFS.

 

Instructions: 

Content

Ingestion Times Flume IndividNumber of counters and the ingestion times obtained for individual PM files into HDFS

Ingestion Times Flume MergedNumber of counters and the ingestion times obtained for merged PM files into HDFS

Ingestion RAM-Counters                RAM and the number of counters ingested to HDFS per hour

Query Times Hive                        Number of counters and the query times attained in Hive for a raw table, a view, one raw column, and a view column

Reporting RAM-Counters        RAM and the number of counters queried in Hive

 

Comments

myself

Submitted by INDRAJIT PAUL on Thu, 11/19/2020 - 23:33

Documentation

AttachmentSize
File README.txt590 bytes