Skip to content

Instantly share code, notes, and snippets.

View stephlocke's full-sized avatar

Steph Locke stephlocke

View GitHub Profile
# Load R packages for use
library("dplyr")
library("recipes")
library("rsample")
library("broom")
library("jsonlite")
library("sessioninfo")
# Sample data
sm_iris = initial_split(iris)
@stephlocke
stephlocke / recursinghubspot.pq
Last active November 2, 2018 19:32
recursing through the hubspot deals api
let
iterations = 10, // Number of iterations
url =
"https://api.hubapi.com/deals/v1/deal/paged?" & "hapikey=demo" & "&includeAssociations=true" & "&limit=1" & "&properties=dealname" & "&propertiesWithHistory=true"
,
FnGetOnePage =
(url) as record =>
let
Source = Json.Document(Web.Contents(url)),
data = try Source[deals] otherwise null,
@stephlocke
stephlocke / find_local_tweeps.R
Last active February 19, 2019 23:24 — forked from noamross/find_local_tweeps.R
A visit to Durham
library(rtweet) #rtweet API creds should already be set up
library(stringi)
library(dplyr)
friends = get_friends(user="stephlocke")
followers = get_followers("stephlocke")
tweeps_id = distinct(bind_rows(friends, followers))
tweeps_info = lookup_users(tweeps_id$user_id)
# A regex for a visit to Durham
@stephlocke
stephlocke / ethicaldatascience.md
Created September 20, 2018 16:08
Some links and resources around ethical data science

Ethical data science

Intro

Who I am

Purpose / Agenda

Problems caused

Facial recognition

Justice system

Access to finance

Ethical obligation

@stephlocke
stephlocke / workingwithgit.md
Last active April 1, 2019 15:49
Work with git! 🎓=💪
title author date
Working with Git
Steph Locke
15 September 2018

Source control fundamentals

Source control concepts

[
{
"userId": 1,
"id": 1,
"title": "Analytics",
"body": "quia et suscipit\nsuscipit recusandae consequuntur expedita et cum\nreprehenderit molestiae ut ut quas totam\nnostrum rerum est autem sunt rem eveniet architecto"
},
{
"userId": 1,
"id": 2,
@stephlocke
stephlocke / PASS.R
Last active August 20, 2018 14:54
Latest R budget scrape plus charts and figures
## ----message=FALSE-------------------------------------------------------
library(tabulizer)
library(tidyverse)
library(zoo)
library(tidytext)
## ------------------------------------------------------------------------
"http://www.pass.org/Portals/0/Governance%202017/2018%20Budget.pdf?ver=2017-10-26-171625-747&timestamp=1509063392150" %>%
tabulizer::extract_text() ->
rawtxt
@stephlocke
stephlocke / htmlwidgetiframeMWE.Rmd
Created July 12, 2018 13:34
Example of trying to get an iframe of a html widget
---
title: "sample"
output:
md_document:
variant: markdown_github
preserve_yaml: true
always_allow_html: yes
---
```{r setup, include = FALSE, message = FALSE, warning = FALSE, error = FALSE}
@stephlocke
stephlocke / scrape.R
Created July 8, 2018 11:41
Scrape and consolidate the year superheroes made their debut in comics
library(tidyverse)
library(rvest)
"https://en.wikipedia.org/wiki/List_of_superhero_debuts" %>%
read_html() %>%
html_nodes(xpath = "//*[@id='mw-content-text']/div/table") %>%
map(html_table, fill = TRUE) %>%
map_df( ~ mutate(., `Year Debuted` = as.character(`Year Debuted`))) %>%
mutate(`Char_Team` = coalesce(`Character / Team / Series`, `Character / Team`)) %>%
select(Char_Team, Year_Debut = `Year Debuted`) %>%
@stephlocke
stephlocke / preconlist.md
Created April 16, 2018 11:43
Current precon offerings

Precons

Practical R for everyone

This hands-on one-day training takes you through the following topics – fundamentals of R, R for ETL, producing reports, and doing data science. Starting with some simple data manipulation, we’ll quickly progress to tools that can make an immediate impact in your day job.

  • For ETL, we’ll look at ways to import and export data, transform it, and apply data quality checks along the way.
  • For producing reports we’ll see how we can build web reports, PDFs, and interactive dashboards.
  • For data science, we’ll look at how R supports you along the process.

By the end of the day, you’ll know some R (including some advanced stuff!) that you can add to your toolbelt.