Last active
March 16, 2020 19:56
-
-
Save SOVIETIC-BOSS88/f174e1ad1fd3215d8339ace83fd2048d to your computer and use it in GitHub Desktop.
FAST AI JOURNEY: COURSE V3. PART 2. LESSON 11. Documenting my fast.ai journey: PAPER REVIEW. REDUCING BERT PRE-TRAINING TIME FROM 3 DAYS TO 76 MINUTES.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
{ | |
"cells": [ | |
{ | |
"cell_type": "markdown", | |
"metadata": {}, | |
"source": [ | |
"# FAST AI JOURNEY: COURSE V3. PART 2. LESSON 11.\n", | |
"## Documenting my fast.ai journey: PAPER REVIEW. REDUCING BERT PRE-TRAINING TIME FROM 3 DAYS TO 76 MINUTES." | |
] | |
}, | |
{ | |
"cell_type": "markdown", | |
"metadata": {}, | |
"source": [ | |
"In this project we dived into the 2019 paper, named Reducing BERT Pre-Training Time from 3 Days to 76 Minutes, by Yang You, Jing Li, Jonathan Hseu, Xiaodan Song, James Demmel, Cho-Jui Hsieh, summarized in the following [Medium Post](https://medium.com/@surhar88/fast-ai-journey-part-2-lesson-11-f0f1d9b6967f)." | |
] | |
}, | |
{ | |
"cell_type": "code", | |
"execution_count": null, | |
"metadata": {}, | |
"outputs": [], | |
"source": [] | |
} | |
], | |
"metadata": { | |
"kernelspec": { | |
"display_name": "Python 3", | |
"language": "python", | |
"name": "python3" | |
}, | |
"language_info": { | |
"codemirror_mode": { | |
"name": "ipython", | |
"version": 3 | |
}, | |
"file_extension": ".py", | |
"mimetype": "text/x-python", | |
"name": "python", | |
"nbconvert_exporter": "python", | |
"pygments_lexer": "ipython3", | |
"version": "3.6.7" | |
} | |
}, | |
"nbformat": 4, | |
"nbformat_minor": 2 | |
} |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment