Skip to content

Instantly share code, notes, and snippets.

View mwcraig's full-sized avatar

Matt Craig mwcraig

View GitHub Profile
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@mwcraig
mwcraig / generate_noisy_data.ipynb
Last active December 5, 2018 23:11
Sample of data sets
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@mwcraig
mwcraig / run_profile_e73b93e.ipynb
Created August 14, 2018 18:55
Memory profile, PR astropy/ccdproc#630 -- Reduce number of open files and del some variables
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@mwcraig
mwcraig / run_profile_df233f3.ipynb
Created August 14, 2018 18:54
Memory profile, PR astropy/ccdproc#642 , AFTER adding memory factor but BEFORE additional factor of 1.5
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@mwcraig
mwcraig / run_profile_a73e72f.ipynb
Last active August 14, 2018 18:55
Memory profile, PR astropy/ccdproc#642, AFTER modification of memory factor by additional factor of 1.5
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@mwcraig
mwcraig / run_profile_a73e72f_memlim_2GB.ipynb
Last active August 14, 2018 18:56
Memory profile, PR astropy/ccdproc#642, AFTER modification of memory factor by additional factor of 1.5, memory limit 2GB
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@mwcraig
mwcraig / run_profile_38d14d2.ipynb
Last active August 14, 2018 18:56
Memory profile, PR astropy/ccdproc#642, BEFORE adding memory factor (effectively current master)
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@mwcraig
mwcraig / run_profile_5ec598c.ipynb
Last active August 14, 2018 18:56
Memory profile, PR astropy/ccdproc#632 -- use numba JIT to speed up median sigma clipping
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@mwcraig
mwcraig / run_with_file_number_limit_copy.py
Created August 11, 2018 17:26
Script for running memory profile in ccdproc
from argparse import ArgumentParser
from tempfile import TemporaryDirectory
from pathlib import Path
import resource
import mmap
import sys
import gc
import psutil