AbdealiLoKo

#!/usr/bin/python
# -*- coding: utf-8 -*-

from __future__ import (division, absolute_import, unicode_literals,
                        print_function)

import datetime
import os
import sys

AbdealiLoKo

AbdealiLoKo

d3 = function() {
  var d3 = {
    version: "3.3.6"
  };
  if (!Date.now) Date.now = function() {
    return +new Date();
  };
  var d3_arraySlice = [].slice, d3_array = function(list) {
    return d3_arraySlice.call(list);
  };

AbdealiLoKo

#!/usr/bin/env node

// To get stats on all channels, call:
//   node ./delete-slack-messages.js
// To delete messages for a particular channel, get the Channel ID and pass as a param:
//   node ./delete-slack-messages.js CHANNEL_ID
// Channel ID is on the the browser URL.: https://mycompany.slack.com/messages/MYCHANNELID/

// CONFIGURATION #######################################################################################################

AbdealiLoKo

name: Python Tests

jobs:
  build:
    runs-on: ubuntu-18.04
    strategy:
      max-parallel: 2
      matrix:
        python-version: [3.5, 3.6, 3.7]

AbdealiLoKo

# Write a spark DataFrame into a single CSV files (to open with Excel/other tools easily)
# Save the file to S3

import s3fs
import pyspark.sql.functions as F  # noqa: N812

def spark_to_csv(spark_df, out_path):
    """
    Save the file in part files with spark and then append them together

AbdealiLoKo

# Example:
# PYJAVA_LIB=jpype venv/bin/python pyjava.py

import os
from datetime import datetime
from jpmml_evaluator import _package_classpath

lib = os.environ.get('PYJAVA_LIB')
assert lib is not None, 'Set env var PYJAVA_LIB to py4j/jnius/jpype'

AbdealiLoKo

Better commit messages

The 3 common ways for developers to document information about their work is:

1. Comments
   • When is this written: When the developer wants something to be clearly and immediately visible to all other developers
   • When is this found: As soon as other developers are reading code, they will find these comments
2. Commit messages
   • When is this written: When the developer wants to explain the work involved in them making a change. Why a change was made, explanation of the
   • When is this found: When other developers dig a big deeper on why or when a change was made - they will find these commit messages
3. Tech Documentation

AbdealiLoKo

Test SQLAlchemy application

Slides: https://docs.google.com/presentation/d/1SMtBILSrqt9SWK5BnEKe4ivGTHItrVjgCEB0AUhGeyM

Setup

$ python -m venv venv
$ venv/bin/pip install sqlalchemy colorama

AbdealiLoKo