This repository is a review of the book 'Natural Language Bible' written by Heiseok Lim et al. This book leads from the basics of natural language processing to pre-trained models including BERT, GPT and Transformers. All of the practice codes are implemented through Google colab. The pdf file is the note taken when reviewing the book.
The overall architecture of the reposit is shown below.
| chapter | about |
|---|---|
| 6 | 구문 분석 (parsing) |
| 7 | 의미 분석 (semantic analysis) |
| 8 | 개체명 인식 (named entity recognition) |
| 9 | 언어모델 (language model) |
| 10 | 정보 추출 (information extraction) |
| 13 | 자연어생성 (natural language generation) |
| 15 | 문서요약 (text summarization) |
| 16 | 텍스트 분류 (text categorization) |
| 18 | 단어 임베딩 (word embedding) |
| 19 | 합성곱 신경망 (CNN) |
| 20 | 순환 신경망 (RNN) |
| 21 | DL기반 형태소 분석 (morpheme analysis) |
| 22 | DL기반 의미역 분석 (thematic analysis) |
| 23 | DL기반 개체명 인식 |
| 24 | DL기반 질의응답 (question answering) |
| 25 | DL기반 기계번역 (machine translation) |
| 26 | DL기반 문장생성 (text generation) |
| 27 | DL기반 문서요약 |
| 28 | DL기반 대화 시스템 (dialogue system) |
| 29 | DL기반 SNS 분석 (SNS analysis) |