- Q1: Implementing BERT from scratch
- Papers:
- Attention Is All You Need!
- GAUSSIAN ERROR LINEAR UNITS (GELUS)
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- Q2: Image Segmentation & Classification with BEIT
- BEIT: BERT Pre-Training of Image Transformers
-
Notifications
You must be signed in to change notification settings - Fork 1
HesamAsad/NeuralNetworksDeepLearning-Fall2022-CA5
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
Computer Assignment #5 [Transformers, BERT, BEIT] - Neural Networks & Deep Learning Course - University of Tehran - Dr. Kalhor
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published