AWS EKS service provides the Kubernetes control plane. Price for EKS Service is $0.20 per hour / cluster.
Three clusters with four worker nodes.
| try: | |
| import requests | |
| import cdx_toolkit | |
| import tqdm | |
| import OpenSSL | |
| from lxml import html | |
| except: | |
| print("you need to do some installs first:\npip install requests cdx_toolkit tqdm pyOpenSSL lxml") | |
| exit(1) |
| #!/usr/bin/env bash | |
| START_TIME=$SECONDS | |
| set -e | |
| echo "-----START GENERATING HLS STREAM-----" | |
| # Usage create-vod-hls.sh SOURCE_FILE [OUTPUT_NAME] | |
| [[ ! "${1}" ]] && echo "Usage: create-vod-hls.sh SOURCE_FILE [OUTPUT_NAME]" && exit 1 | |
| # comment/add lines here to control which renditions would be created | |
| renditions=( |
| Rank | Type | Prefix/Suffix | Length | |
|---|---|---|---|---|
| 1 | Prefix | my+ | 2 | |
| 2 | Suffix | +online | 6 | |
| 3 | Prefix | the+ | 3 | |
| 4 | Suffix | +web | 3 | |
| 5 | Suffix | +media | 5 | |
| 6 | Prefix | web+ | 3 | |
| 7 | Suffix | +world | 5 | |
| 8 | Suffix | +net | 3 | |
| 9 | Prefix | go+ | 2 |
| # finds all *.js files that have either `</` or `/>` tags in them and renames them to *.jsx | |
| find ./src -type f -name '*.js' -not -name '*.jsx' -not -name '*.ejs' -exec bash -c 'grep -l -E "</|/>" "$0"' {} \; -exec bash -c 'mv "$0" "${0%.js}.jsx"' {} \; |
I am assuming you are here because like me, you installed a bazillion different python interpreters on mac and the whole thing is a spagetti. Today, I finally fixed my python installation. Whatever I install for python2 or python3 using pip JUST.WORKS.. My god! finally.
Here is what I had messed up, which you also probably did:
| import gc | |
| import gzip | |
| import time | |
| import json | |
| import shutil | |
| import os,sys | |
| import tldextract | |
| import collections | |
| import pandas as pd | |
| from tqdm import tqdm |
We need to create a virtual env for our app to run in: More Here Run this command in whatever folder you want to create your venv folder
python -m venv ./venv
A list of useful commands for the FFmpeg command line tool.
Download FFmpeg: https://www.ffmpeg.org/download.html
Full documentation: https://www.ffmpeg.org/ffmpeg.html
Build an ETL job service by fetching data from a public API endpoint and dumping it into an AWS Redshift database.
Published on Jan. 11th, 2018 at https://serverless.com/blog/serverless-application-for-long-running-process-fargate-lambda/
AWS dropped so many serverless announcements at re:Invent, the community is still scrambling to make sense of them all. This post is all about AWS Fargate.
In this article, I will show you how to create an end-to-end serverless application that extracts thumbnails from video files. But, oh no, processing video files is a long-running process! Whatever will we do?