Skip to content

Instantly share code, notes, and snippets.

View cassioeskelsen's full-sized avatar
🏠
Working from home

Cassio Rogerio Eskelsen cassioeskelsen

🏠
Working from home
38 followers · 27 following
  • Unico IDTech
  • Blumenau, SC, Brazil
  • 16:41 (UTC -03:00)
  • X @sricanesh
View GitHub Profile
@cassioeskelsen
cassioeskelsen / workflows_commands.sh
Created November 16, 2022 02:58
GCP Workflows commands
#initial setup
export PROJECT_ID=real-state-wf #altere para o nome desejado
export SERVICE_ACCOUNT=workflows-sa
export INCOMING_TOPIC_ID=rent-request
export SUCCES_TOPIC_ID=sucess-topic
export NOT_SUCESS_TOPIC_ID=not-sucess-topic
export REGION=us-east1 #você pode alterar pela sua preferência
export WORKFLOW_NAME=house-rent
gcloud config set project ${PROJECT_ID}
gcloud config set run/region ${REGION}
@cassioeskelsen
cassioeskelsen / application.properties
Last active April 12, 2022 23:59
debezium.sink.type=eventhubs
debezium.sink.eventhubs.connectionstring=Endpoint=sb://xxxx
debezium.sink.eventhubs.hubname=xxxxx
debezium.sink.eventhubs.maxbatchsize=1048576
debezium.source.connector.class=io.debezium.connector.sqlserver.SqlServerConnector
debezium.source.offset.storage.file.filename=data/offsets.dat
debezium.source.offset.flush.interval.ms=0
debezium.source.database.database.applicationIntent=ReadOnly
debezium.source.database.hostname=zzzz.database.windows.net
@cassioeskelsen
cassioeskelsen / deployment_debezium.yaml
Last active April 12, 2022 03:02
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
name: #{deployment}#-pvc-data
namespace: #{namespace}#
spec:
storageClassName: default
accessModes:
- ReadWriteOnce
resources:
@cassioeskelsen
cassioeskelsen / Dockerfile
Created April 11, 2022 01:31
FROM registry.access.redhat.com/ubi8/openjdk-11
LABEL maintainer="Debezium Community"
#
# Set the version, home directory, and MD5 hash.
#
ENV DEBEZIUM_VERSION=1.8.0.CR1 \
SERVER_HOME=/debezium \
MAVEN_REPO_CENTRAL="https://repo1.maven.org/maven2"
@cassioeskelsen
cassioeskelsen / alterando_cdc.sql
Last active April 11, 2022 00:17
/* Criação de uma nova capture instance */
EXEC sys.sp_cdc_enable_table
@source_schema = N'Faturamento'
@source_name = N'NotasFiscais',
@role_name = N'CDC_Reader',
@capture_instance = N'NotasFiscais002',
@supports_net_changes = 0
GO
/* Exclusão da antiga capture instance */
@cassioeskelsen
cassioeskelsen / ativando_cdc_por_tabela.sql
Last active April 10, 2022 23:57
EXEC sys.sp_cdc_enable_table
@source_schema = N'Faturamento'
@source_name = N'NotasFiscais',
@role_name = N'CDC_Reader',
@capture_instance = N'NotasFiscais001',
@supports_net_changes = 0
@cassioeskelsen
cassioeskelsen / ativando_cdc.sql
Created April 10, 2022 23:44
EXEC sys.sp_cdc_enable_db
GO
/*Criar uma role para o usuário debezium: */
CREATE ROLE CDC_Reader
GO
/*Criar um usuário para leitura do CDC: */
CREATE USER [debezium-cdc] WITH PASSWORD = '<senha>'
GO
@cassioeskelsen
cassioeskelsen / pros_contras_datalake.csv
Created April 6, 2022 23:46
Prós Contras
Suporta vários Formatos Data Swamps
Suporta Machine Learning Dificuldade de utilização em BIs
Análises mais complexas Exigência de pessoal especializado
@cassioeskelsen
cassioeskelsen / pros_contras_dw.csv
Created April 3, 2022 23:23
Prós Contras
Excelente para BIs Apenas dados estruturados
Sistemas proprietários com interface SQL
Dados Estáticos
Suporte limitado para Machine Learning
@cassioeskelsen
cassioeskelsen / totalization.py
Created March 14, 2022 03:14
async def main() -> dict:
async with redis.client() as conn:
keys = await conn.keys("votos_*")
for key in keys:
if key != 'votos_bd':
print("Votos de " + key.split("_")[1] + " - " + await conn.get(key))