kaugm

spot-log query service

Install this next to your spot-controller to print logs from the Spot.io Ocean. This service simply spits out logs to stdout in JSON format. Then your log aggregation service can use the container logs and publish them to your own logging platform.

Install

kubectl apply -f spot-logs.yaml --namespace kube-system

kaugm

AWSTemplateFormatVersion: '2010-09-09'
Description: Cognito Stack
Parameters:
  AuthName:
    Type: String
    Description: Unique Auth Name for Cognito Resources

Resources:
  # Creates a user pool in cognito for your app to auth against
  # This example requires MFA and validates the phone number to use as MFA

kaugm

#!/opt/homebrew/bin/python3
"""
Proof of Concept: Refresh nodes in Ocean Cluster once they reach a certain uptime. Script created per customer request for this functionality.

Purpose: Currently, Ocean does not support the ability to automatically detach "old" nodes once they reach a certain uptime and spin up fresh nodes to replace them.

How it works:
1. Pull the current node count of the Ocean cluster via the API
2. Loop through the list of nodes
3. For each node, if its uptime is greater than a predefined limit, detach it

kaugm

#!/opt/homebrew/bin/python3
"""
Proof of Concept: On-Demand Count per Ocean VNG (AWS K8s). Need to test how Ocean rounds to nearest whole instance based on Spot Percentage.

Purpose: Currently, Ocean does not support the configuration of 'On-Demand Count', only Elastigroup does. By running this script with AWS Lambda + EventBridge CRON scheduling, on say an hourly basis, this functionality can be approximated.

How it works:
1. Pull the current node count of the Ocean cluster via the API
2. Breakdown node count into separate VNGs
3. For each VNG (or desired VNG), calculate what Risk (Spot Percentage) would equate to having 1x On-Demand instance ( using math.ceil() )

kaugm

AWSTemplateFormatVersion: "2010-09-09"
Description: This template creates an Elastigroup. This is not meant to be run as a standalone CloudFormation template, but rather to have the Parameters and Resource added to existing ASG CloudFormation templates to create and manage both simultaneously. All API parameters in Spot documentation are valid for the Elastigroup resource https://docs.spot.io/api/#tag/Elastigroup-AWS/operation/elastigroupAwsCreate

Parameters:
  ServiceToken:
      Type: String
      Description: ARN of Lambda function in Spot's AWS account that will handle creation of Elastigroup. DO NOT CHANGE THIS.
      Default: arn:aws:lambda:us-west-2:178579023202:function:spotinst-cloudformation

  accessToken:

kaugm

#!/usr/bin/env bash

# This script shows how to call the Spot.io API via a shell script and contains 4 examples for HTTP methods: GET, POST, PUT, and DELETE
# Requires jq
# Written by Karl Martin


# [Optional] Set Spot token and account manually. Currently set as environment variables
# SPOTINST_TOKEN=''
# SPOTINST_ACCOUNT_AWS=''

kaugm

#!/opt/homebrew/bin/python3

try:
    import requests
    import os
    import json
    import re
    import csv
    from datetime import datetime
except ModuleNotFoundError:

kaugm

#!/opt/homebrew/bin/python3
"""
Perform Spot.io API calls with Python
Ensure body JSON is correct when performing API calls, otherwise the response will be 'bad request'.
"""

try:
    import requests
    import os
    import json

kaugm

#!/opt/homebrew/bin/python3

import os
from datetime import datetime

try:
    from spotinst_sdk2 import SpotinstSession
    from spotinst_sdk2.models.ocean.aws import *
except ModuleNotFoundError:
    print('Spotinst SDK Library not installed. Exiting..')

kaugm

class MySQL_Connection:
    """Connection to MySQL database
    
    Arguments:
    HOST: <class 'str'> Full hostname to connect to
    DATABASE: <class 'str'> Database within host
    """

    # Get Database Credentials From Environment Variables
    DB_USERNAME = os.environ.get('SPOT_DB_USERNAME')