Skip to content

Instantly share code, notes, and snippets.

View allansene's full-sized avatar

Allan Sene Oliveira allansene

View GitHub Profile
@allansene
allansene / dag.py
Created September 12, 2019 00:22 — forked from adamhaney/dag.py
DBT Airflow DAG with model/graph introspection
from datetime import datetime, timedelta
import networkx as nx
from airflow import DAG
from airflow.operators import BashOperator, SubDagOperator
start_date = datetime(year=2017, month=6, day=13, hour=19, minute=0)
schedule_interval = '0 * * * 1-5'
default_args = {
OUTPUT="Backup created at /data/bkp/dremio-bkp-2019_04_25/dremio_backup_2019-04-25_15.56, dremio tables 25, uploaded files 0"
REGEX=\/.*?(\,) # Returns: /data/bkp/dremio-bkp-2019_04_25/dremio_backup_2019-04-25_15.56, dremio tables 25,
REGEX2=\/.+?(\,) # Returns: /data/bkp/dremio-bkp-2019_04_25/dremio_backup_2019-04-25_15.56, dremio tables 25,
REGEX3=\/.*?(?=\,) # Returns nothing
if [[ $OUTPUT =~ $REGEX ]]; then echo ${BASH_REMATCH}; fi
if [[ $OUTPUT =~ $REGEX2 ]]; then echo ${BASH_REMATCH}; fi
if [[ $OUTPUT =~ $REGEX3 ]]; then echo ${BASH_REMATCH}; fi
{
"source": [
"aws.ecr"
],
"detail-type": [
"AWS API Call via CloudTrail"
],
"detail": {
"eventSource": [
"ecr.amazonaws.com"
{
"repositoryName": "enterprise-project-service-api",
"imageTag": "1.3.0",
"registryId": "num_sua_conta",
"imageManifest": "{\n \"schemaVersion\": 2,\n ... ]\n}"
}
@allansene
allansene / lambda_common_policy.json
Created September 12, 2018 20:08
Policy para execução da Lambda e logs no CloudWatch
{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Action": [
"logs:CreateLogGroup",
"logs:CreateLogStream",
"logs:PutLogEvents"
],
@allansene
allansene / lambda_deploy_ecs.py
Last active September 12, 2018 20:00
Script que faz deploy de uma imagem no ECS a partir de um evento PutImage no ECR
from __future__ import print_function
import boto3
PROJECT_PREFIX = 'enterprise-project-service-'
ACCOUNT_ID = None
ECR_SUFFIX = '.dkr.ecr.us-east-1.amazonaws.com/'
# the event is from pattern $.requestParameters
# take a look at sample-event.json
Caused by: java.lang.IncompatibleClassChangeError: Implementing class
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
@allansene
allansene / bestPrices-payload.json
Created October 4, 2017 13:42
Payload dos novos campos a adicionar no api-search
{
searchIntention.bestPrices:{
maxmilhas:{
latam: {
miles: 30000,
price_airline: 500,
price_maxmilhas: 200
},
gol: {
miles: 30000,
@allansene
allansene / api-search_changes.json
Last active October 4, 2017 13:40
Properties adicionadas no template api-search-* dentro do nó searchIntention
"bestPrices": {
"properties": {
"airline": {
"properties": {
"avianca": {
"properties": {
"miles": {
"type": "long"
},
"price_airline": {
@allansene
allansene / query-best-price.json
Created September 25, 2017 16:11
Query de Best Price para retorno no AdWords
{
"size": 0,
"query": {
"bool": {
"must": [
{
"match_phrase": {
"searchIntention.from": {
"query": "[PASSAR AQUI O AEROPORTO]"
}