Comparative Analysis and Evaluation of Stemming and Preprocessing Techniques for Arabic Text
Keywords:Natural Language Processing, Information Retrieval, Arabic Information Retrieval, Stemming , Text Preprocessing
Arabic information retrieval is challenging due to the language's complex morphology and syntax. Preprocessing and stemming improve the accuracy and efficiency of Arabic information retrieval. This paper provides a comprehensive analysis of the existing literature on Arabic preprocessing and stemming techniques. The paper identifies the limitations and challenges of these techniques. The paper emphasizes the importance of preprocessing and stemming and underscores the need for further research to improve Arabic information retrieval. This study evaluates ten stemmers on a public dataset. The results show that root-based stemmers: Lucene, and khoja got the highest reduction rate 90.9%, and 85% respectively. The results emphasize that root-based stemmers have good conflating ability for similar terms, while light-based stemmers under-stem similar terms.
How to Cite
Copyright (c) 2023 Samer Mohammed Yaseen, Abdualmajed A. G. Al-Khulaidi
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.