Punjabi Text Corpus encoded in a machine readable form and stored in a standard format. The major encoding being used is Unicode and stored in XML format. The data is embedded with metadata information. The corpus has been created from contemporary text in typed and crawled methods. LDC-IL Punjabi Text Corpus size is 1,01,25,770 words drawn from 2,470  different titles. The five major domains are Aesthetics, Science & Technology, Social Science, Commerce and Mass Media.

Overview

Punjabi is the principal and administrative language of Punjab. Punjabi is not only spoken in Punjab in India it is also a language of Lehnda Punjab in Pakistan. Punjabi is an Indo-Aryan language.This same Punjabi language is being written in two epigraphs,in Gurmukhi script and Shahmukhi script. In our Eastern Punjab it is being used in Gurmukhi and Lehnda Punjab (Pakistan) using Shahmukhi script.

Punjabi is written in Shahmukhi scripts as well. ‘Shahmukhi’ is a variant of ‘Perso-Arabic’ script.But LDC-IL Punjabi text corpus is collected in Gurmukhi script for contemporary usage.