| Topic | Article PDF | Type | |
|---|---|---|---|
| 1 | Map Reduce | MapReduce: Simplified Data Processing on Large Clusters | Required |
| 2 | Pig | Pig Latin: A Not-So-Foreign Language for Data Processing | Required |
| Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience | Recommended | ||
| 3 | Google File System | The Google File System | Required |
Leon Overweel leonoverweel
leonoverweel
/ check_notebooks_cleared.py
Created
December 2, 2021 11:41
Simple Python script to fail CI/CD checks if Jupyter notebooks aren't cleared
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import glob | |
| import subprocess | |
| import sys | |
| CLEAR_COMMAND = "jupyter nbconvert --to notebook --inplace --clear-output" | |
| DIFF_COMMAND = "git diff --quiet --exit-code" | |
| # Clear notebook outputs | |
| for notebook_file in glob.glob("notebooks/*.ipynb"): | |
| subprocess.run([*CLEAR_COMMAND.split(), notebook_file]) |
leonoverweel
/ revue_to_markdown.py
Last active
September 11, 2019 20:28
Convert a Revue newsletter issue to markdown; currently supported content types: title, headers, paragraphs, lists, blockquotes, and images.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import sys | |
| from urllib import request | |
| from bs4 import BeautifulSoup | |
| import html2text | |
| # CSS classes used by Revue | |
| CLS_BLOCKQUOTE = 'revue-blockquote' | |
| CLS_H2 = 'header-text' |
leonoverweel
/ informatics-urls
Last active
October 18, 2018 11:11
People page URLS for University of Edinburgh Informatics Academic Staff (October 2018)
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| http://www.inf.ed.ac.uk/people/staff/Stefano_Albrecht.html | |
| http://www.inf.ed.ac.uk/people/staff/Cristina_Adriana_Alexandru.html | |
| http://www.inf.ed.ac.uk/people/staff/Paul_Anderson.html | |
| http://www.inf.ed.ac.uk/people/staff/Stuart_Anderson.html | |
| http://www.inf.ed.ac.uk/people/staff/Pavlos_Andreadis.html | |
| http://www.inf.ed.ac.uk/people/staff/Myrto_Arapinis.html | |
| http://www.inf.ed.ac.uk/people/staff/James_Armstrong.html | |
| http://www.inf.ed.ac.uk/people/staff/Damal_Arvind.html | |
| http://www.inf.ed.ac.uk/people/staff/David_Aspinall.html | |
| http://www.inf.ed.ac.uk/people/staff/Malcolm_Atkinson.html |
leonoverweel
/ informatics-staff.md
Last active
September 28, 2023 09:58
University of Edinburgh Informatics Academic Staff (October 2018)
| Name | Position | Groups | Personal Page | Publications |
|---|---|---|---|---|
| Stefano Albrecht | Lecturer in Artificial Intelligence | Centre for Intelligent Systems and their Applications, Institute of Perception, Action and Behaviour | Personal page link | Publications link |
| Cristina Alexandru | Research Associate | Centre for Intelligent Systems and their Applications, Institute for Language, Cognition and Computation | Personal page link | Publications link |
| Paul Anderson | Research Fellow | Centre for Intelligent Systems and their Applications | Personal page link | [Publications link](http://www.research.ed.ac.uk/portal/en/persons |