magnetikonline

List AWS Lambda@Edge log groups across regions

AWS Lambda@Edge functions, which run under CloudFront at multiple edge locations require associated Lambda functions to exist within each AWS region.

By design, this means CloudWatch Logs produced by Lambda@Edge functions will exist across these regions.

This Bash script will query for all log groups associated to Lambda@Edge functions for each enabled region of the current AWS account to hopefully help determine where logs are going/exist.

magnetikonline

Delete S3 versioned objects and delete markers

Quick and dirty Bash script to iterate an S3 bucket and remove all object versions and delete markers.

Probably only usable on buckets with a few hundred version objects maximum, otherwise it might be more efficient and time effective to use a lifecycle rule to age out and remove objects in bulk.

Reference

• https://gist.github.com/weavenet/f40b09847ac17dd99d16

magnetikonline

Install The Silver Searcher (ag) on macOS from source

A quick n' dirty bash script to install the following:

• automake, pkg-config, PCRE, xz - all needed by ag configure.
• ag - from source.

Requires as a minimum Xcode CLI tools (don't need a full Xcode install). Can be done via the following:

$ xcode-select --install

magnetikonline

Golang net/http middleware flow

$ go run main.go
Called middleware03()
Called middleware02()
Called middleware01()
Called initial()

magnetikonline

Golang private modules within a GitHub organization

You've got Golang modules within a private repository or an organization and would like to go get them.

For this example the GitHub organization will be spacely-sprockets.

Howto

Set GOPRIVATE (ideally placed in your .bashrc / dotfiles):

magnetikonline

Find latest non beta/RC release for Docker CLI

Using curl and jq to:

• Pull list of GitHub release tags.
• Filter out all that don't match vX.Y.Z (stripping beta/rc).
• Finally return just the first entry (latest tag).

$ curl --silent \

magnetikonline

Creating a 'run once' systemd unit

Systemd unit template which calls a script exactly once on startup and keeps unit status active after script exits.

Unit file placed in /etc/systemd/system and enabled with:

$ sudo systemctl enable runonce.service
$ sudo systemctl start runonce.service

magnetikonline

DynamoDB local quick usage guide

Running a local version of DynamoDB inside a Docker container.

Commands

$ docker pull amazon/dynamodb-local:latest
$ docker run --publish 8000:8000 amazon/dynamodb-local

# in another terminal

magnetikonline

Golang io.TeeReader() example

• Opening a source words file.
• Create a io.TeeReader(), writing read file chunks also to a gzip writer.
• Output source chunks as read and total bytes.
• Finally, output compressed bytes and total compressed size.

Output

$ go run main.go

magnetikonline

GitHub token validation regular expressions

Regular expressions to check if a given GitHub token could be valid.

• Personal access tokens (classic)
• Fine-grained personal access tokens
• GitHub Actions
• Combined together

Personal access tokens (classic)