Sometimes tar files have tar files, and it might be nice to read the contents of some files several layers deep. Here's how we can do it with Ruby and Python3 with no external dependencies.
We can create a layered tar file (a tar file containing other tar files) using docker save or podman save
% podman save fpm-ubuntu-18.04 -o test.tar
As a note, if you find errors with the math below, please let me know.
This cost comparison only compares cost per I/O operation. It does not discuss storage or transit costs.
| --version 1.2.3.4 |
| % docker build -t rust . | |
| ... | |
| # Export the image to tarball, which itself contains tarballs and a manifest.json | |
| % docker save -o rust.tar rust | |
| # Extract the last layer | |
| # tar's -O flag extracts a single entry from the tarball. | |
| # The file we want is the last "Layer" in the manifest.json | |
| % tar -xf rust.tar -O $(tar -xf rust.tar -O manifest.json | jq -r '.[].Layers[-1]') > curlbash.tar |
| [Unit] | |
| Description=no description given | |
| [Service] | |
| Type=simple | |
| User=root | |
| Group=root | |
| # Load env vars from /etc/default/ and /etc/sysconfig/ if they exist. | |
| # Prefixing the path with '-' makes it try to load, but if the file doesn't | |
| # exist, it continues onward. |
| #include <X11/Xlib.h> | |
| #include <stdio.h> | |
| #include <stdlib.h> | |
| int main() { | |
| Display *dpy; | |
| // Below here, Copilot generated the rest. | |
| dpy = XOpenDisplay(NULL); | |
| if (dpy == NULL) { |
% git clone --depth 1 https://github.com/home-assistant/core
% grep -l climate */const.py | awk -F/ '{print $1}' | xargs -n1 sh -c 'jq .iot_class $1/manifest.json | grep -q local && echo "* https://www.home-assistant.io/integrations/$1"' -
Operation: Decouple whisper from graphite.
Method: Create a graphite function that does a date histogram facet query against elasticsearch for a given query string for the time period viewed in the current graph.
Reason: graphite has some awesome math functions. Wouldn't it be cool if we could use those on logstash results?
The screenshot below is using logstash to watch the twitter stream of keywords "iphone" "apple" and "samsung" - then I graph them each, so we get an idea of popularity. As a bonus, I also do a movingAverage() on the iphone curve to show you why this is awesome.
The problem is that some lines in the file are missing timestamps when they aren't continuations of any previous line. It's dumb, really.
The mysql query log is seriously bullshit format, but nothing logstash can't unscrew.
The main goal here is to show how we can fix the 'missing timestamp' problem.
% ruby bin/logstash agent -e '