DonRichards

#!/bin/bash
DOCKER_COMPOSE_FILE="docker-compose.yml"

# Check if docker-compose file exists
if [ ! -f "$DOCKER_COMPOSE_FILE" ]; then
    echo "Docker Compose file not found at $DOCKER_COMPOSE_FILE"
    exit 1
fi

# Extract ports from the 'ports' section of 'traefik' service

DonRichards

#!/bin/bash
# DRAFT: untested at the moment

# FITS File Processor for Dataverse Upload
# -----------------------------------------
# This script iterates through each .fits file in the specified directory, extracts the star number from 
# the file name, and uses this information to construct a JSON payload. It then executes a curl command 
# to upload each file to a specified Dataverse server using the provided API token and Persistent ID. 
# The output of each curl command, along with relevant data, is logged to 'log.txt' for record-keeping 
# and debugging purposes.

DonRichards

urls_to_prewarm.py

This script is designed to "pre-warm" the cache of a Cantaloupe IIIF server by sending requests to specified image URLs with multiple IIIF endpoints. The script reads image URLs from a provided text file, combines each URL with a set of IIIF endpoints, and then sends concurrent requests to the server to access and cache these images. By doing so, it ensures that the specified images are readily available in the server's cache for faster subsequent access. The script also includes error handling for missing or empty input files and provides a help menu for user guidance.

preheat.sh

More or less the same as the python script.

Review

To fetch a list of frequently accessed IIIF assets. (Untested)

cat access.log | grep "/iiif/2/" | awk '{print $7}' | sort | uniq -c | sort -n

DonRichards

Recently Created (within 30 days) that are missing TN files

SELECT 
    h.handle
FROM 
    handle h
JOIN
    item i
ON
    h.resource_id = i.uuid

DonRichards

Grab.py retrieves URLs for either "Intermediate Files" or "Original Files" and appends them to a CSV file.

The script includes a feature for resuming its progress in case of an interruption or error. As a precaution, it adjusts the URLs from the production server to redirect them to a staging server.

Additionally, the script incorporates error-handling mechanisms, utilizing a try-catch-retry approach, to gracefully manage timeouts.

Setup to run

python3 -m venv .venv
source .venv/bin/activate

DonRichards

#!/usr/bin/env bash

# This generates the header bases by what terms were returned.
# This makes merging them complicated.

curl https://islandora.traefik.me/content/taxonomy-terms/export > taxonomy_terms_000.csv

for i in {1..10000..100}
do
	echo "Loop $i"

DonRichards

Get all of the repos

It downloads all of the repos for a person or organization.

DonRichards

Starting diagnostics

[PASS] DD0027: is there available disk space on the host?
[PASS] DD0028: is there available VM disk space?
[PASS] DD0018: does the host support virtualization?
[PASS] DD0001: is the application running?
[PASS] DD0017: can a VM be started?
[PASS] DD0016: is the LinuxKit VM running?
[PASS] DD0011: are the LinuxKit services running?
[PASS] DD0004: is the Docker engine running?

DonRichards

How to Download Lynda with youtube-dl with an organization login

Needed:

Cookies Export youtube-dl

• Install Cookies Export
• Login to Lynda and navigate to the course you want
• Cookies export button in browser
• Copy "cookie.txt" to your desktop

DonRichards

How to delete old emails in Gmail

This script will delete emails old than 30 days with a specified label.

Focussing on emails that are from a mailing list I signed up for. I used Gmails filters to move specific email to a label called "Mailing List". You can set the label to "inbox" if you'd like but this would delete everything in your inbox older than 30 days.

Move emails to a "Mailing List" label

To protect your inbox I suggest moving emails you know are safe to delete to a new label.

• From your inbox click the checkbox next to the email > More > "Filter Messages Like this"
• Select how this filter selects the email (either From, Subject, To, etc)