This project is focused on the tasks of headline generation and summary generation in the Nepali language. We prepare our own datasets for both tasks. The scripts that we prepared while working on the project are provided here.
The dataset has been collected by scraping online Nepali news portals. The headline generation dataset has 286k article-title pairs and the summary generation dataset is still very much in progress.
Currently the system is based on the Pointer-Generator Network discussed in Get To The Point: Summarization with Pointer-Generator Networks (See et. al. (2017)) together with the intra attention and reinforcement learning techniques discussed in A Deep Reinforced Model For Abstractive Summarization (Paulus et. al. (2017)). We currently use the implementation of this ensemble network as found here, with plans to implement a Transformer network for the same task. This new system is incomplete.
The ROUGE-1, ROUGE-2 and ROUGE-L scores for the headline generation task are 35.71, 18.53 and 32.89 respectively, far from 40+ ROUGE-1 and ROUGE-L for the same in the English language. The go-to headline generation dataset for English is the English Gigaword which has about 4 million article-title pairs.
The summary generation task is not complete yet, so we do not report scores for it. (We are opening this repo only for academic evaluation and grading purposes.)
Web scraping was done with the Scrapy Python package. The spiders are inside the spiders folder.
A comprehensive guide to creating the dataset using these scripts will be provided soon. The processed headlines dataset can be found here.
| Type | Sentence |
|---|---|
| Article | काठमाडौं उपत्यकासहित आसपासका क्षेत्रमा पनि शुक्रबार बिहानै भीषण हावाहुरी चलेको छ । हावाहुरीसँगै वर्षा पनि भएको छ । बिहान साढे # बजेबाट सुरु भीषण हावाहुरी र वर्षा एक घण्टाभन्दा बढी सयमयसम्म आएको थियो । |
| Reference | काठमाडौंमा पनि भीषण हावाहुरी |
| System | काठमाडौंमा भीषण हावाहुरी , हावाहुरीसँगै वर्षा |
Project members: Anjelika Sah, Pragya Bhandari, Subarna Subedi, Sharad Duwal.
For the completion of Machine Learning (COMP 484) course at Kathmandu University. Mar 2020.