Skip to content

Instantly share code, notes, and snippets.

@a-chumagin
a-chumagin / my_suite.json
Last active June 26, 2023 07:15
Params in test
{
"data_asset_type": null,
"expectation_suite_name": "my_suite",
"expectations": [
{
"expectation_type": "expect_column_values_to_be_between",
"kwargs": {
"column": {
"$PARAMETER": "column_name"
},
@a-chumagin
a-chumagin / test-taxi-datasource.py
Created April 4, 2023 20:29
GX: checkpoint in parallel
import great_expectations as gx
from great_expectations.data_context.types.base import DataContextConfig, FilesystemStoreBackendDefaults
import os
from great_expectations.core.batch import RuntimeBatchRequest
import pytest
@pytest.fixture
def create_context():
context_dir = os.path.abspath("./tripdata")
import great_expectations as gx
from great_expectations.data_context.types.base import DataContextConfig, FilesystemStoreBackendDefaults
import os
import logging
logging.basicConfig()
logging.getLogger('sqlalchemy.engine').setLevel(logging.INFO)
context_dir = os.path.abspath("./mysql-context")
@a-chumagin
a-chumagin / Dockerfile
Last active October 13, 2022 13:46
GX quick check result
FROM python:3.7-slim-bullseye
RUN pip install great-expectations==0.15.26
COPY ./*.py /
ENTRYPOINT ["/usr/local/bin/python", "check.py"]
POLYGON((33.59601218050673 -96.19406055623665,33.59714961149158 -96.19402300531044,33.59716301634673 -96.19508813624537,33.59602111719493 -96.19512032275355,33.59601218050673 -96.19406055623665))
@a-chumagin
a-chumagin / google-maps-polygon-coordinates-tool.markdown
Created February 11, 2020 12:17
Google Maps Polygon Coordinates Tool

Google Maps Polygon Coordinates Tool

Outputs the coordinates (longitude, latitude) for Google Maps whenever the Polygon is moved or re-shaped. Recently added a 'Copy to Clipboard' button and had data output into a textarea for easier copying & pasting

I originally built this to build map outlines for neighborhoods, villages, districts and counties - specifically for real estate purposes.

A Pen by Jeremy Hawes on CodePen.

License.

@a-chumagin
a-chumagin / Link
Created December 17, 2019 05:37
DeepTraffic is a deep reinforcement learning competition
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@a-chumagin
a-chumagin / Dockerfile
Last active June 21, 2019 20:47
simple_flask_server
FROM alpine:latest
RUN apk update && apk add python3
RUN python3 -m ensurepip
COPY ./requirements.txt /opt/flask_auth/requirements.txt
WORKDIR /opt/flask_auth
RUN pip3 install -r requirements.txt
@a-chumagin
a-chumagin / notes.txt
Created May 28, 2019 20:01
install Kubernetes cluster
The first thing that we are going to do is use SSH to log in to all machines. Once we have logged in, we need to elevate privileges using sudo.
sudo su
Disable SELinux.
setenforce 0
sed -i --follow-symlinks 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/sysconfig/selinux
Enable the br_netfilter module for cluster communication.
modprobe br_netfilter
echo '1' > /proc/sys/net/bridge/bridge-nf-call-iptables
Ensure that the Docker dependencies are satisfied.