Skip to content

Instantly share code, notes, and snippets.

@SOVIETIC-BOSS88
Last active March 16, 2020 19:56
Show Gist options
  • Save SOVIETIC-BOSS88/f174e1ad1fd3215d8339ace83fd2048d to your computer and use it in GitHub Desktop.
Save SOVIETIC-BOSS88/f174e1ad1fd3215d8339ace83fd2048d to your computer and use it in GitHub Desktop.
FAST AI JOURNEY: COURSE V3. PART 2. LESSON 11. Documenting my fast.ai journey: PAPER REVIEW. REDUCING BERT PRE-TRAINING TIME FROM 3 DAYS TO 76 MINUTES.
Display the source blob
Display the rendered blob
Raw
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# FAST AI JOURNEY: COURSE V3. PART 2. LESSON 11.\n",
"## Documenting my fast.ai journey: PAPER REVIEW. REDUCING BERT PRE-TRAINING TIME FROM 3 DAYS TO 76 MINUTES."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"In this project we dived into the 2019 paper, named Reducing BERT Pre-Training Time from 3 Days to 76 Minutes, by Yang You, Jing Li, Jonathan Hseu, Xiaodan Song, James Demmel, Cho-Jui Hsieh, summarized in the following [Medium Post](https://medium.com/@surhar88/fast-ai-journey-part-2-lesson-11-f0f1d9b6967f)."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": []
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.6.7"
}
},
"nbformat": 4,
"nbformat_minor": 2
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment