Skip to content

Instantly share code, notes, and snippets.

View mtreg's full-sized avatar

Mike Treglia mtreg

View GitHub Profile
@mtreg
mtreg / FacDB_pgtable_unique.txt
Last active May 8, 2017 15:37
FacDB pgtable Unique Entries
pgtable
usnps_facilities_parks
usdot_facilities_airports
dcas_facilities_colp;dot_facilities_parkingfacilities
dcas_facilities_colp;omb_facilities_libraryvisits
bic_facilities_tradewaste
dfta_facilities_contracts;hhs_facilities_proposals
acs_facilities_daycareheadstart;doe_facilities_universalprek;dohmh_facilities_daycare
doe_facilities_schoolsbluebook;hhs_facilities_proposals
nycdoc_facilities_corrections
@mtreg
mtreg / NYHOPS_netCDF_Example.R
Created March 3, 2017 04:21
Load Stevens Institute NYHOPS netCDF data into R
#Sample Code
#Gets netCDF data for lat/long points from Stevens Institute NYHOPS Data
library(ncdf4)
#Connect to netCDF
nyhops.nc <- nc_open("http://colossus.dl.stevens-tech.edu/thredds/dodsC/LISS/Hindcast/all_nb_mon_81.nc")
##To get 'simple', 3D variale (e.g., depth)
#Load depth, lat, and long
@mtreg
mtreg / RODBC_Install_Output.R
Created March 2, 2017 17:39
Output of installing RODBC on ubuntu 14.04
> install.packages("RODBC")
Installing package into ‘/usr/local/lib/R/site-library’
(as ‘lib’ is unspecified)
--- Please select a CRAN mirror for use in this session ---
trying URL 'https://cloud.r-project.org/src/contrib/RODBC_1.3-14.tar.gz'
Content type 'unknown' length 1163799 bytes (1.1 MB)
==================================================
downloaded 1.1 MB
* installing *source* package ‘RODBC’ ...
@mtreg
mtreg / Download_Unzip.R
Last active August 16, 2016 18:54
Issue Unzipping NYC OpenData Download File in R
#Initiate Download of file, naming it as test.zip
download.file(url='https://data.cityofnewyork.us/api/geospatial/tqmj-j8zm?method=export&format=Original', destfile="test.zip")
#unzip the file using built in functionality
unzip('test.zip')
#Throws error when running on Windows:
#Warning message:
#In unzip("test.zip") : error 1 in extracting from zip file
@mtreg
mtreg / makefile_syllabusHTML.sh
Created January 7, 2016 22:31
Markdown to HTML via Pandoc with appropriate header and footer
#!bin/bash
pandoc ../CourseInfo/Syllabus.md -o syllabus_tmp.html;
cat html_head.html syllabus_tmp.html html_foot.html > ../Syllabus.html;
rm syllabus_tmp.html
@mtreg
mtreg / gist:b44b2892170487895a3b
Created May 25, 2015 03:32
Round Time to Nearest 10 minutes - No dependencies (ignoring seconds)
et <- example_time <- Sys.time()
#This code will work on list of times, or can easily be set up to work on a column of a data frame
#The seconds are ignored and actually set to 0 (which was adequate for my needs)
for(i in et){
if(as.POSIXlt(et)$min >= 10)
{
if((as.POSIXlt(et)$min/5) %% 1 == 0)
{
et <- et + 60
@mtreg
mtreg / gist:1cdcd5bc4fb246e2b667
Last active August 29, 2015 14:11
Download, Unzip, Mosaic, and Reproject National Elevation Dataset 1/3 arcsecond
#All of this tested in in Cygwin on Windows 7 x64
#Requires GDAL, Cygwin (or other *nix terminal) with wget and unzip installed; also requires an installation of Python
#GDAL should be in system PATH
#To download files based on a hand-made text file called "URLZipList.txt" - list of all the .zip filenames needed (files from here: ftp://rockyftp.cr.usgs.gov/vdelivery/Datasets/Staged/NED/13/IMG/):
#Example file name: "ftp://rockyftp.cr.usgs.gov/vdelivery/Datasets/Staged/NED/1/IMG/n39w096.zip"
wget -i URLZipList.txt
#Unzip all files to respective folders
for z in *.zip; do