| Wed Sep 01 |
Gaussian Error Linear Units (GELUs) , Hendrycks, Gimpel; 2016 |
Draft Summary |
| Sun Sep 05 |
Gaussian Error Linear Units (GELUs) , Hendrycks, Gimpel; 2016 |
Final Summary |
| Wed Sep 08 |
Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates , Smith, Topin; 2017 |
Draft Summary |
| Sun Sep 12 |
Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates , Smith, Topin; 2017 |
Final Summary |
| Fri Sep 17 |
High-Performance Large-Scale Image Recognition Without Normalization , Brock, De, Smith, Simonyan; 2021 |
Review both summaries |
| Sun Sep 26 |
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , Devlin, Chang, Lee, Toutanova; 2018 |
Coding |
| Wed Sep 29 |
LambdaNetworks: Modeling Long-Range Interactions Without Attention , Bello; 2021 |
Draft Summary |
| Sun Oct 03 |
LambdaNetworks: Modeling Long-Range Interactions Without Attention , Bello; 2021 |
Final Summary |
| Wed Oct 06 |
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions , Wang, Xie, Li, Fan, Song, Liang, Lu, Luo, Shao; 2021 |
Draft Summary |
| Sun Oct 10 |
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions , Wang, Xie, Li, Fan, Song, Liang, Lu, Luo, Shao; 2021 |
Final Summary |
| Fri Oct 15 |
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis , Mildenhall, Srinivasan, Tancik, Barron, Ramamoorthi, Ng; 2020 |
Review both summaries |
| Sun Oct 24 |
CornerNet: Detecting Objects as Paired Keypoints , Law, Deng; 2018 |
Coding |
| Wed Oct 27 |
Center-based 3D Object Detection and Tracking , Yin, Zhou, Krähenbühl; 2020 |
Draft Summary |
| Sun Oct 31 |
Center-based 3D Object Detection and Tracking , Yin, Zhou, Krähenbühl; 2020 |
Final Summary |
| Wed Nov 03 |
Learning Transferable Visual Models From Natural Language Supervision , Radford, Kim, Hallacy, Ramesh, Goh, Agarwal, Sastry, Askell, Mishkin, Clark, Krueger, Sutskever; 2021 |
Draft Summary |
| Sun Nov 07 |
Learning Transferable Visual Models From Natural Language Supervision , Radford, Kim, Hallacy, Ramesh, Goh, Agarwal, Sastry, Askell, Mishkin, Clark, Krueger, Sutskever; 2021 |
Final Summary |