John Purcell lockefox
lockefox
/ skill_trading_plot.r
Last active
February 18, 2016 13:24
PROSPER Skill Trade/RMT Plotting script
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| library(RODBC) | |
| library(ggplot2) | |
| library(grid) | |
| library(reshape) | |
| library(scales) | |
| library(data.table) | |
| library(quantmod) | |
| library(jsonlite) | |
| library(cowplot) | |
| library(plyr) |
lockefox
/ prosper_specialZoomin.r
Last active
March 17, 2016 03:31
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| library(RODBC) | |
| library(ggplot2) | |
| library(grid) | |
| library(reshape) | |
| library(scales) | |
| library(data.table) | |
| library(quantmod) | |
| library(jsonlite) | |
| library(cowplot) |
lockefox
/ PROSPER_CREST_markethistory.r
Last active
July 1, 2016 19:13
Single Item CREST market history extraction - Like @EVEprosper
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| packages.list <- c("data.table", | |
| "quantmod", | |
| "jsonlite") | |
| packages.new <- packages.list[!(packages.list %in% installed.packages()[,"Package"])] | |
| if(length(packages.new)){ | |
| install.packages(packages.new) | |
| } | |
| library(data.table) | |
| library(quantmod) | |
| library(jsonlite) |
lockefox
/ stock_prophet_experiment.R
Last active
February 27, 2017 19:17
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #### Libraries #### | |
| library(quantmod) #getSymbols/chartSeries | |
| library(zoo) #rollmean/rollapply | |
| library(plyr) | |
| library(TTR) | |
| library(prophet) | |
| library(dplyr) | |
| library(ggplot2) | |
| library(ggthemes) | |
| library(cowplot) |
lockefox
/ crest_history_prophet.R
Last active
April 16, 2017 13:50
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| packages.list <- c( | |
| "data.table", | |
| "quantmod", | |
| "jsonlite", | |
| "prophet", | |
| "dplyr", | |
| "ggplot2", | |
| "ggthemes", | |
| "cowplot", | |
| "zoo" |
lockefox
/ sample_km.json
Created
August 19, 2017 16:41
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "killID": 64158479, | |
| "solarSystemID": 30000157, | |
| "killTime": "2017-08-19 16:28:48", | |
| "moonID": 0, | |
| "victim": { | |
| "shipTypeID": 583, | |
| "characterID": 94315372, | |
| "characterName": "Canatana Jovakko", | |
| "corporationID": 1699307293, |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import requests | |
| import pymongo | |
| req = requests.get('https://zkillboard.com/api/losses/solo/') | |
| req.raise_for_status() | |
| recent_solo_losses_raw = req.json() #200 latest events | |
| conn = pymongo.MongoClient(MONGO_CONNECTION_STRING) | |
| conn.db.zkb.insert(recent_solo_losses_raw) |
lockefox
/ dict_query.py
Created
August 19, 2017 17:10
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import pymongo | |
| import pandas as pd | |
| conn = pymongo.MongoClient(MONGO_CONNECTION_STRING) | |
| exclude_data = {'_id': False, 'attackers': False, 'items': False} | |
| raw_data = list(conn.db.zkb.find({}, projection=exclude_data)) | |
| kill_df = pd.DataFrame(raw_data) |
lockefox
/ cleanup.py
Created
August 19, 2017 17:39
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## Split out JSON-blob columns into their own tables ## | |
| # Rotates out key/value pairs into their own columns | |
| position_df = pd.DataFrame(list(kill_df['position'])) | |
| victim_df = pd.DataFrame(list(kill_df['victim'])) | |
| zkb_df = pd.DataFrame(list(kill_df['zkb'])) | |
| ## Merge pivoted data back into source frame ## | |
| # row-index has not changed, append-horizontally | |
| combined_df = pd.concat([kill_df, position_df, victim_df, zkb_df], axis=1) |
lockefox
/ pivot_list_concat.py
Last active
August 22, 2017 19:34
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| data_columns = ['killID', 'solarSystemID', 'killTime', 'moonID'] | |
| pivot_column = 'items' | |
| index_column = 'killID' | |
| ## Make source DataFrame ## | |
| raw_df = pd.DataFrame(raw_data) | |
| ## Row-by-row rotate and append desired data ## | |
| result_df = None | |
| for row in raw_df.itertuples(): |