Word Sense Disambiguation For Punjabi Language Using Intelligent Techniques

Abstract

Natural Language Processing is one of the major sub-domains under Artificial Intelligence. It forms the basis of the technique that allows a machine to communicate in a manner similar to humans. This implies that the machine is capable of understanding the context in which a discussion is going on and is able to give an intelligent response to it. The different algorithms under Machine Learning have been instrumental in defining a framework that helps in this process.The algorithms for word sense disambiguation can be divided into supervised, unsupervised, semi-supervised and knowledge-based methods. Supervised systems need to be trained with sense-tagged corpus, learn the relationship between the specific sense and the context, and get a classifier for each word. Unsupervised approach utilizes clustering technique to cluster words based on their context to distinguish senses. Semi-supervised systems adopt bootstrapping methods which learn knowledge from a small sense-tagged corpus and extend their knowledge from a small sense-tagged corpus and extend their knowledge with the existing knowledge. Knowledge based methods mainly utilize external knowledge base, such as dictionary and ontology to choose the most appropriate sense. The supervised approach has shown good results in deciphering the context of the ambiguous word.On experimentation, we found that the results were moderate as compared to supervised classifier which indicated that the results indicated a positive swing towards determining the right context to be looked for the given ambiguous word.The experimental outcomes have showcased that the results are above moderate and can be improved further by increasing the stored cases in the case repository. The work has been done in Punjabi language which is one of the regional languages of India.Thus the hybrid methodology of combing the un-supervised technique with case-based reasoning would prove to be beneficial for deciphering the many contexts of the Punjabi ambiguous word.