Researchers

Molham Al-Maleh, Mohammad Said Desouki

Published in

Journal of Big Data, Volume 7, Article number 109, December 2020.

Abstract

Natural language processing has witnessed remarkable progress with the advent of deep learning techniques. Text summarization, along other tasks like text translation and sentiment analysis, used deep neural network models to enhance results. The new methods of text summarization are subject to a sequence‑to‑sequence framework of encoder–decoder model, which is composed of neural networks trained jointly on both input and output. Deep neural networks take advantage of big datasets to improve their results. These networks are supported by the attention mechanism, which can deal with long texts more efficiently by identifying focus points in the text. They are also supported by the copy mechanism that allows the model to copy words from the source to the summary directly. In this research, we are re‑implementing the basic summarization model that applies the sequence‑to‑sequence framework on the Arabic language, which has not witnessed the employment of this model in the text summarization before. Initially, we build an Arabic data set of summarized article headlines. This data set consists of approximately 300 thousand entries, each consisting of an article introduction and the headline corresponding to this introduction. We then apply baseline summarization models to the previous data set and compare the results using the ROUGE scale.

Keywords: Natural language processing - Text summarization - Deep learning - Big data - Sequence-to-sequence framework.

Link to read full paper

https://doi.org/10.1186/s40537-020-00386-7