Datasets
Standard Dataset
UPMVM datasets
- Citation Author(s):
- Submitted by:
- Asia Zaman
- Last updated:
- Mon, 07/01/2024 - 12:36
- DOI:
- 10.21227/ehx7-jf87
- Data Format:
- License:
- Categories:
- Keywords:
Abstract
UPMVM used three datasets named UD1, UD2 and UD3. UD1 is primarily used to collect and retrieve 280 poetry meters (rhythmic patterns [بحر]) and their corresponding feet. Other uses of this dataset include the design of DFA state function sequences with terminal state information to align the identified verse meters. UD2 is collected from [GitHub - sayedzeeshan/Aruuz] and updated. This update process involves the parsing and tokenization of the UD2 dataset. Arud rules are then applied to each token for its discretization, resulting in a tok-taqti which is then added to the vocabulary if it is not already present. This dataset UD2 contains 80,000 Urdu words and their diacritics, language information, and word variations. The third dataset UD3 is used to evaluate the proposed model. UD3 contains 500 verses including structure-based genre, collected from published books.