miqui

Dynamo DB

---

General Info

• DynamoDB is schemaless
• use DynamoDb Stream when item is updated to primary table and also inserted into a secondary table
• When looking for a good partition key use one with Automatically generated GUID
• If large table, use queries instead of scans
• In order to work with search queuries:
  • Specify a key condition expression in the query
• Specify a partition key name and value in the equality condition

miqui

Filtering queries

Find slowest write queries

parse @message /Query_time: (?<queryTime>.*?) Lock_time: (<?lockTime>.*?) Rows_sent: (?<rowsSent>.*?) Rows_examined: (?<rowsExamined>.*?)\s(?<query>.*?)$/
  | filter @message like /(?i)insert/
  | sort queryTime desc
  | limit 10

miqui

Req id:

parse @message '(*) *' as reqId, message
| filter reqId like "c19dd3fc-5f27-11e9-a823-930d231e2ab8"
| sort @timestamp asc
| limit 50

Status code:

miqui

    ___      _____          ___         _   _  __ _        _   ___                  _ _          ___              _      _ _        
   /_\ \    / / __|  ___   / __|___ _ _| |_(_)/ _(_)___ __| | / __| ___ __ _  _ _ _(_) |_ _  _  / __|_ __  ___ __(_)__ _| | |_ _  _ 
  / _ \ \/\/ /\__ \ |___| | (__/ -_) '_|  _| |  _| / -_) _` | \__ \/ -_) _| || | '_| |  _| || | \__ \ '_ \/ -_) _| / _` | |  _| || |
 /_/ \_\_/\_/ |___/        \___\___|_|  \__|_|_| |_\___\__,_| |___/\___\__|\_,_|_| |_|\__|\_, | |___/ .__/\___\__|_\__,_|_|\__|\_, |
                                                                                          |__/      |_|                        |__/
                                                                                          
Notes taken in Mar-2018, from acloud.guru and AWS FAQ

  ___                  _ _          _  __  _ 
 / __| ___ __ _  _ _ _(_) |_ _  _  / |/  \/ |

miqui

CloudWatch Insights Queries

Assorted queries for AWS CloudWatch Insights

miqui

filter @type = "REPORT"
| stats
    avg(@billedDuration) as Average,
    percentile(@billedDuration, 99) as NinetyNinth,
    percentile(@billedDuration, 95) as NinetyFifth,
    percentile(@billedDuration, 90) as Ninetieth
    by bin(30m)

miqui

/**
 * AWS Lambda (Node) - Using Insight API to Query your Cloudwatch Log for Daily Error Report
 * @author Zeno Yu <zeno.yu@gmail.com>
 */
const AWS = require('aws-sdk');
var cloudwatchlogs = new AWS.CloudWatchLogs();

exports.handler = async (event) => {

  // Cloudwatch Log Group name

miqui

ssh-keygen -t rsa -b 4096 -N '' -C "rthijssen@gmail.com" -f ~/.ssh/id_rsa
ssh-keygen -t rsa -b 4096 -N '' -C "rthijssen@gmail.com" -f ~/.ssh/github_rsa
ssh-keygen -t rsa -b 4096 -N '' -C "rthijssen@gmail.com" -f ~/.ssh/mozilla_rsa

miqui

Creating Self Signed Certificates for use with Node and Chrome

Creating the certificate files

1. Generate a private key with open ssl.

   $ openssl genrsa -des3 -out /var/lib/ssl/self-signed.key 1024

2. Generate a CSR (Certificate Signing Request).

miqui

Client-side SSL

For excessively paranoid client authentication.

Using self-signed certificate.

Create a Certificate Authority root (which represents this server)

Organization & Common Name: Some human identifier for this server CA.

openssl genrsa -des3 -out ca.key 4096
openssl req -new -x509 -days 365 -key ca.key -out ca.crt