data-henrik

# this is not a script, but you may turn it into such
# it assumes that you already installed OBS Studio (sudo dnf install obs-studio)
# you could start by creating a project directory "obs"

# make obs
# cd obs

# clone the source for loopback device
git clone https://github.com/umlaeute/v4l2loopback
cd v4l2loopback

data-henrik

# See https://cloud.ibm.com/docs/terraform?topic=terraform-getting-started
# for details on IBM Cloud and Terraform

# First, obtain an IBM Cloud IAM token
# Thereafter, create a new IAM service ID and as
# follow-up step, using a local execution environment,
# utilize curl to create and download an API key.

# Obtain the IBM Cloud IAM authentication token
# It is needed for the embedded curl command below

data-henrik

Introduction

Let's assume a simple schema consisting of two tables.

1. STATISTICS for COVID-19 daily statistics like confirmed cases, deaths, etc.
2. DEMOGRAPHICS with addition per-country data like population, area, population density and more

STATISTICS

This table could have columns such as

• country_id: Identifies the country by ISO code

data-henrik

# Define functions to download as CSV or Excel
from IPython.display import HTML
import pandas as pd
import base64, io

# Download as CSV: data frame, optional title and filename
def create_download_link_csv(df, title = "Download CSV file", filename = "data.csv"):  
    # generate in-memory CSV, then base64-encode it
    csv = df.to_csv(index=False)
    b64 = base64.b64encode(csv.encode())

data-henrik

import ibm_db
import pandas as pd
import ibm_db_dbi as dbi
import json,sys,os

def db2test(iamKey,hostname):
    connstr="DATABASE=BLUDB;Authentication=GSSplugin;HOSTNAME={};PORT=50001;PROTOCOL=TCPIP;SECURITY=SSL;APIKEY={};".format(hostname,iamKey)
    conn1 = dbi.connect(connstr)
    # Quick test with Pandas and dataframe
    df = pd.read_sql("select count(*) from syscat.tables", conn1)

data-henrik

# IBM Cloud Functions / OpenWhisk action to 
# 1) obtain an IAM Bearer token based on API key from env
# 2) fetch credentials in JSON object from Key Protect key
# 3) return the arguments, credentials and token

import json,sys,os
import requests,base64

# obtain IAM access token 
def getAuthToken(api_key):

data-henrik

#!/bin/bash
#
# Obtain the necessary credentials from environment, encode them
# as base64 JSON and upload them a new key to IBM Cloud Key Protect
#
# The following software is used:
# - base64
# - ibmcloud: IBM Cloud CLI with Key Protect (kp) plugin

data-henrik

Setup

Add this to your .profile, .bashrc, .zshrc...

BASE64_DECODER_PARAM="-d" # option -d for Linux base64 tool
echo AAAA | base64 -d > /dev/null 2>&1 || BASE64_DECODER_PARAM="-D" # option -D on MacOS

decode_base64_url() {
  local len=$((${#1} % 4))
  local result="$1"
 if [ $len -eq 2 ]; then result="$1"'=='

data-henrik

# Simple test of the Db2 on Cloud REST API
# Written by Henrik Loeser, hloeser@de.ibm.com
# https://cloud.ibm.com/apidocs/db2-on-cloud
import requests, json, sys, time

# Read credentials from file
def readCreds(filename):
    with open(filename) as data_file:
        credentials = json.load(data_file)
    return credentials

data-henrik

From database into Watson Discovery

The code shown is a simple Python example of pulling data from a SQL database supported by SQLAlchemy, and then injecting the data as new JSON document into a collection of Watson Discovery Service on IBM Cloud.