Skip to content

Instantly share code, notes, and snippets.

Avatar

ExpandingMan

  • Port Jefferson, NY
View GitHub Profile
@ExpandingMan
ExpandingMan / sysinfo.txt
Created October 15, 2022 15:40
Steam System Information
View sysinfo.txt
Computer Information:
Manufacturer: ASUSTeK COMPUTER INC.
Model: TUF GAMING X570-PLUS (WI-FI)
Form Factor: Desktop
No Touch Input Detected
Processor Information:
CPU Vendor: AuthenticAMD
CPU Brand: AMD Ryzen 7 3800X 8-Core Processor
CPU Family: 0x17
@ExpandingMan
ExpandingMan / tree_benchmarks.jl
Created August 29, 2022 23:48
basic benchmarks for best-case AbstractTrees iteration
View tree_benchmarks.jl
using AbstractTrees, BenchmarkTools, Random
using AbstractTrees: PreOrderState, next
using Base: @kwdef
@kwdef struct RandTreeParams
max_generations::Int = 5
max_children::Int = 3
end
@ExpandingMan
ExpandingMan / riftbreaker-steam.log
Created November 18, 2021 04:00
Riftbreaker crash log
View riftbreaker-steam.log
This file has been truncated, but you can view the full file.
======================
Proton: 1636976115 experimental-6.3-20211115
SteamGameId: 780310
Command: ['/home/expandingman/.local/share/Steam/steamapps/common/Riftbreaker/bin/Launcher.exe']
Options: {'forcelgadd'}
depot: 0.20211014.30
pressure-vessel: 0.20210906.2
scripts: v0.20210917.0-0-g1cf127d
soldier: 0.20211013.0 soldier 0.20211013.0
Kernel: Linux 5.14.10-1-MANJARO #1 SMP PREEMPT Thu Oct 7 06:43:34 UTC 2021 x86_64
View gist:ba33fff3245cf49ab048188111cabb37
Computer Information:
Manufacturer: Unknown
Model: Unknown
Form Factor: Desktop
No Touch Input Detected
Processor Information:
CPU Vendor: AuthenticAMD
CPU Brand: AMD Ryzen 7 3800X 8-Core Processor
CPU Family: 0x17
@ExpandingMan
ExpandingMan / ThePlan.md
Created July 14, 2021 00:12
plan for distributed tables in Julia
View ThePlan.md

The Plan

The ultimate goal is to have a package or set of packages for large-scale distributed computing on tabular data in Julia that works "out of the box". We would like to be able to replace processes that run in e.g. Apache Spark or Python's dask.

Examples of things we'd like to be able to do:

  • Get table metadata for a table that is spread across a hundred CSV files in HDFS.
  • Join a 10^10 row table which is stored as parquet files on S3 buckets with a 100 row table that we create locally in memory, perform a groupby operation and save to a new table as parquet files on S3.
@ExpandingMan
ExpandingMan / ensemble_heisenbug.jl
Created July 8, 2021 02:11
standalone geodesic EnsembleProblem that worked fine
View ensemble_heisenbug.jl
using DifferentialEquations, LinearAlgebra, ThreadsX, DiffEqGPU, StaticArrays, ThreadsX, BenchmarkTools
struct DnegWormhole
ρ::Float64
a::Float64
M::Float64
end
const DEFAULT_WORMHOLE = Ref{DnegWormhole}(DnegWormhole(1.0, 0.5, 0.5))
default_wormhole() = DEFAULT_WORMHOLE[]
@ExpandingMan
ExpandingMan / jloptshack.jl
Created May 30, 2020 18:47
a hack to turn on trace compiling while Julia is running
View jloptshack.jl
function hacked_jlopts(jlopts::Base.JLOptions, str::String)
f = (n, arg) -> n == :trace_compile ? pointer(str) : arg
GC.@preserve str Base.JLOptions((f(n, getproperty(jlopts, n)) for n ∈ fieldnames(Base.JLOptions))...)
end
function hack_jlopts(str::String)
ptr = convert(Ptr{Base.JLOptions}, cglobal(:jl_options))
jlopts = hacked_jlopts(Base.JLOptions(), str)
unsafe_store!(ptr, jlopts)
jlopts
@ExpandingMan
ExpandingMan / write_test_arrow.py
Created March 19, 2019 00:49
writing some arrow test data
View write_test_arrow.py
import pyarrow as pa
v = pa.array([1,2,3,4])
batch = pa.RecordBatch.from_arrays([v], ["this_is_the_column_name"])
sink = pa.BufferOutputStream()
writer = pa.RecordBatchStreamWriter(sink, batch.schema)
@ExpandingMan
ExpandingMan / init.vim
Last active August 3, 2018 20:20
cvim configuration
View init.vim
let searchengine duckduckgo = "https://duckduckgo.com/?q=%s&t=vivaldi"
let defaultengine = "duckduckgo"
" key bindings
map d x
@ExpandingMan
ExpandingMan / automatetestPOC.jl
Last active December 21, 2017 17:31
rough, primitive proof-of-concept for automated random unit testing in Julia
View automatetestPOC.jl
using Base.Test
using MacroTools
"""
argnametype(arg::Expr)
Given an argument of the form `x::DType` extracts the argument name (`x`) and
data type (`DType`) as a tuple.
"""
function argnametype(arg::Expr)