| Wed Sep 01 |
Mish: A Self Regularized Non-Monotonic Activation Function , Misra; 2019 |
Draft Summary |
| Sun Sep 05 |
Mish: A Self Regularized Non-Monotonic Activation Function , Misra; 2019 |
Final Summary |
| Wed Sep 08 |
SGDR: Stochastic Gradient Descent with Warm Restarts , Loshchilov, Hutter; 2016 |
Draft Summary |
| Sun Sep 12 |
SGDR: Stochastic Gradient Descent with Warm Restarts , Loshchilov, Hutter; 2016 |
Final Summary |
| Fri Sep 17 |
Layer Normalization , Ba, Kiros, Hinton; 2016 |
Review both summaries |
| Sun Sep 26 |
A Primer in BERTology: What we know about how BERT works , Rogers, Kovaleva, Rumshisky; 2020 |
Coding |
| Wed Sep 29 |
Big Bird: Transformers for Longer Sequences , Zaheer, Guruganesh, Dubey, Ainslie, Alberti, Ontanon, Pham, Ravula, Wang, Yang, Ahmed; 2020 |
Draft Summary |
| Sun Oct 03 |
Big Bird: Transformers for Longer Sequences , Zaheer, Guruganesh, Dubey, Ainslie, Alberti, Ontanon, Pham, Ravula, Wang, Yang, Ahmed; 2020 |
Final Summary |
| Wed Oct 06 |
LeViT: a Vision Transformer in ConvNet’s Clothing for Faster Inference , Graham, El-Nouby, Touvron, Stock, Joulin, Jégou, Douze; 2021 |
Draft Summary |
| Sun Oct 10 |
LeViT: a Vision Transformer in ConvNet’s Clothing for Faster Inference , Graham, El-Nouby, Touvron, Stock, Joulin, Jégou, Douze; 2021 |
Final Summary |
| Fri Oct 15 |
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains , Tancik, Srinivasan, Mildenhall, Fridovich-Keil, Raghavan, Singhal, Ramamoorthi, Barron, Ng; 2020 |
Review both summaries |
| Sun Oct 24 |
Objects as Points , Zhou, Wang, Krähenbühl; 2019 |
Coding |
| Wed Oct 27 |
Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object |
|
| Detection for Autonomous Driving , Wang, Chao, Garg, Hariharan, Campbell, Weinberger; 2018 |
Draft Summary |
|
| Sun Oct 31 |
Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object |
|
| Detection for Autonomous Driving , Wang, Chao, Garg, Hariharan, Campbell, Weinberger; 2018 |
Final Summary |
|
| Wed Nov 03 |
Contrastive Learning of Medical Visual Representations from Paired |
|
| Images and Text , Zhang, Jiang, Miura, Manning, Langlotz; 2020 |
Draft Summary |
|
| Sun Nov 07 |
Contrastive Learning of Medical Visual Representations from Paired |
|
| Images and Text , Zhang, Jiang, Miura, Manning, Langlotz; 2020 |
Final Summary |
|