Datasets
Standard Dataset
UPMVM datasets
- Citation Author(s):
- Submitted by:
- Asia Zaman
- Last updated:
- Mon, 07/01/2024 - 12:36
- DOI:
- 10.21227/ehx7-jf87
- Data Format:
- License:
- Categories:
- Keywords:
Abstract
UPMVM used three datasets named UD1, UD2 and UD3. UD1 is primarily used to collect and retrieve 280 poetry meters (rhythmic patterns [بحر]) and their corresponding feet. Other uses of this dataset include the design of DFA state function sequences with terminal state information to align the identified verse meters. UD2 is collected from [GitHub - sayedzeeshan/Aruuz] and updated. This update process involves the parsing and tokenization of the UD2 dataset. Arud rules are then applied to each token for its discretization, resulting in a tok-taqti which is then added to the vocabulary if it is not already present. This dataset UD2 contains 80,000 Urdu words and their diacritics, language information, and word variations. The third dataset UD3 is used to evaluate the proposed model. UD3 contains 500 verses including structure-based genre, collected from published books.
<p class="MsoNormal" style="margin-left: 27.3pt; text-align: justify;"><span style="font-size: 10.0pt;">UPMVM uses three datasets named UD1, UD2 and UD3. UD1is primarily used to collect and retrieve 290 poetry meters (rhythmic patterns [<span lang="AR-SA" dir="RTL">بحر</span>]) and their corresponding feet. Other uses of this dataset include the design of DFA state function sequences with terminal state information to align the identified verse meters. UD2 is collected from [</span><a href="https://github.com/sayedzeeshan/Aruuz"><strong><span style="font-size: 10pt; color: #0070c0; background-image: initial; background-position: initial; background-size: initial; background-repeat: initial; background-attachment: initial; background-origin: initial; background-clip: initial;">GitHub - sayedzeeshan/Aruuz</span></strong></a><strong><span style="text-decoration: underline;"><span style="font-size: 10.0pt; color: #0070c0;">] </span></span></strong><span style="font-size: 10.0pt;">and updated. This update process involves the parsing and tokenization of UD2 dataset. Arud rules are then applied to each token for its discretization, resulting into a tok-taqti which is then added to vocabulary if it is not already present. This dataset UD2 contains 80,000 Urdu words along with their diacritics, language information, and word variations. The third dataset UD3 is used to evaluate the proposed model. UD3 contains 500 verses including structure-based genre, collected from published books, </span></p>