Skip to content

Instantly share code, notes, and snippets.

View wolfeidau's full-sized avatar
🐺
Building data science projects

Mark Wolfe wolfeidau

🐺
Building data science projects
View GitHub Profile
@wolfeidau
wolfeidau / go.mod
Last active February 6, 2024 00:13
Testing out adbc to duckdb.
SIGSEGV: segmentation violation
PC=0x0 m=10 sigcode=2
signal arrived during cgo execution
goroutine 1 [syscall]:
runtime.cgocall(0x10083c984, 0x14000115418)
/opt/homebrew/Cellar/go/1.21.6/libexec/src/runtime/cgocall.go:157 +0x44 fp=0x140001153e0 sp=0x140001153a0 pc=0x100485044
github.com/apache/arrow-adbc/go/adbc/drivermgr._Cfunc_AdbcStatementRelease(0x14000184000, 0x1400050c930)
_cgo_gotypes.go:498 +0x34 fp=0x14000115410 sp=0x140001153e0 pc=0x100818694
github.com/apache/arrow-adbc/go/adbc/drivermgr.(*stmt).Close.func1(0x14000115478?, 0x0?)
@wolfeidau
wolfeidau / terraform.cfn.yaml
Created August 1, 2023 01:07
CFN for terraform State and Locks
AWSTemplateFormatVersion: 2010-09-09
Description: >
wolfeidau: Terraform state and locks infrastructure
Parameters:
Environment:
Type: String
Default: dev
Outputs:
TerraformLockTableName:
@wolfeidau
wolfeidau / main.go
Created July 5, 2023 21:40
Copy columns to new file.
package main
import (
"fmt"
"os"
"github.com/alecthomas/kong"
"github.com/apache/arrow/go/v13/parquet"
"github.com/apache/arrow/go/v13/parquet/compress"
"github.com/apache/arrow/go/v13/parquet/file"
@wolfeidau
wolfeidau / main.go
Created March 1, 2023 21:23
Tags lister
package main
import (
"context"
"encoding/json"
"fmt"
"log"
"github.com/aws/aws-sdk-go-v2/config"
"github.com/aws/aws-sdk-go-v2/service/resourcegroupstaggingapi"
@wolfeidau
wolfeidau / customers.json
Last active October 8, 2022 23:09
Apache Arrow Write Example
{
"customers": [
{
"customer_id": "c7281d12-9ea0-4574-b41a-3a6de5aba119",
"name": "Party Foods",
"created_date": "2022-08-23T22:18:31.445Z"
}
]
}
@wolfeidau
wolfeidau / gitprompt.sh
Created May 1, 2022 03:20
Some code i use to configure my git prompt
source /usr/lib/git-core/git-sh-prompt
# export PS1='[\u@\h \W$(__git_ps1 " (%s)")]\$ '
export GIT_PS1_SHOWDIRTYSTATE=1 GIT_PS1_SHOWSTASHSTATE=1 GIT_PS1_SHOWUNTRACKEDFILES=1
export GIT_PS1_SHOWUPSTREAM=verbose GIT_PS1_DESCRIBE_STYLE=branch GIT_PS1_SHOWCOLORHINTS=1
export GIT_PS1_HIDE_IF_PWD_IGNORED=1
# Colorful prompt for Bash!
export PS1='\[\e[0;36m\][\A] \u@\h:\[\e[0m\e[0;32m\]\W\[\e[1;33m\]$(__git_ps1 " (%s)")\[\e[0;37m\] \$\[\e[0m\] '
@wolfeidau
wolfeidau / template.yaml
Last active March 8, 2022 05:50
Firehose to datadog
AWSTemplateFormatVersion: '2010-09-09'
Description: "wolfeidau: Notifications stream which sends events to datadog"
Parameters:
Environment:
Type: String
AllowedValues: [prod, nonprod]
DatadogHttpEndpointUrl:
Type: String
Default: https://aws-kinesis-http-intake.logs.datadoghq.com/v1/input
@wolfeidau
wolfeidau / notes.md
Created November 23, 2021 05:21
APIGW HTTP API linking lambda and APIGW logs.
@wolfeidau
wolfeidau / microservices.md
Created October 28, 2021 05:57
Some notes on microservice resources.
@wolfeidau
wolfeidau / Muffins.md
Last active August 2, 2021 11:40
This is my customised muffin recipe