Skip to content

Instantly share code, notes, and snippets.

View sleroy's full-sized avatar

Sylvain Leroy sleroy

View GitHub Profile
@sleroy
sleroy / glue_script_using_jdbc_thread_pool.py
Created November 7, 2024 09:54
Glue example with concurrent thread pool to parallelize jdbc writes
import sys
from awsglue.transforms import *
from awsglue.utils import getResolvedOptions
from pyspark.context import SparkContext
from awsglue.context import GlueContext
from awsglue.job import Job
from pyspark.sql.functions import col
from awsglue.dynamicframe import DynamicFrame
## @params: [JOB_NAME]
@sleroy
sleroy / glue_script_using_spark_jdbc.py
Created November 7, 2024 09:24
Example how to use partitions to leveral several executors for reading and parallel writes using partition column key.
import sys
from awsglue.transforms import *
from awsglue.utils import getResolvedOptions
from pyspark.context import SparkContext
from awsglue.context import GlueContext
from awsglue.job import Job
from pyspark.sql.functions import col, spark_partition_id
from awsglue.dynamicframe import DynamicFrame
## @params: [JOB_NAME]
import groovy.transform.ToString
/**
* identité => type
*
* Objet : element à une vie
* => créé ( réification , donner vie, donner substance à un concept abstrait)
* => utilisé
* => détruit
*/
class Utilisateur {
@sleroy
sleroy / isFrenchPhoneNumber.js
Created July 22, 2020 20:52
Ponicode generated test
const rewire = require("rewire")
const example = rewire("./example")
const isFrenchPhoneNumber = example.__get__("isFrenchPhoneNumber")
// @ponicode
describe("isFrenchPhoneNumber", () => {
test("0", () => {
let result = isFrenchPhoneNumber("+33688261221")
expect(result).toBe(true)
})
})
@sleroy
sleroy / example.js
Created July 22, 2020 20:22
Code example for Ponicode
function addition(operandA, operandB) {
return operandA + operandB;
}
function fullName(firstName, lastName) {
return firstName + " " + lastName;
}
function isFrenchPhoneNumber(phoneNumber) {
return phoneNumber.startsWith("+33");
package ch.salt.code.challenge;
import java.util.ArrayList;
import java.util.LinkedList;
import java.util.List;
@sleroy
sleroy / jenkins-is-dead.md
Created January 20, 2020 12:47 — forked from michaellihs/jenkins-is-dead.md
Jenkins is dead - long live Jenkins!

Jenkins is dead - long live Jenkins!

Brainstorming

  • Basic Concepts
    • Continuous Delivery

      Delivering Software with confidence, small increments, frequent releases, requires automated tested, automated deployment, automated infrastructure

  • Pipelines
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8" />
<meta name="description" content="What does artificial intelligence mean? How does machine learning work? These are tough questions, but important ones to answer. In The Verge’s Real World AI Issue we’re going to look at how this technology is being used in the world around you — here and now.">
<meta name="author" rel="www.linkedin.com/in/sylvain-leroy-byoskill">
<meta name="viewport" content="width=device-width, initial-scale=1">
<link rel="stylesheet" href="https://stackpath.bootstrapcdn.com/bootstrap/4.2.1/css/bootstrap.min.css" integrity="sha384-GJzZqFGwb1QTTN6wy59ffF1BuGJpLSa9DkKMp0DgiMDm4iYMj70gZWKYbI706tWS"
crossorigin="anonymous">
@sleroy
sleroy / Dockerfile
Last active October 28, 2018 22:50
maven + gcloud + docker image
# docker build -t sleroy/byoskill-agent:0.1 .
FROM docker:rc
MAINTAINER sleroy <sleroy0@gmail.com>
# GKE build & testing environment for Circle CI 2.0
USER root
ENV NODEJS_VERSION v8
ENV DOCKER_VERSION rc
@sleroy
sleroy / gist:d5931075ea7cbe350aee32af156a6bbf
Created October 26, 2017 15:21
Generating Docker with Gradle, the easy and ugly way....
buildscript {
repositories {
mavenLocal()
mavenCentral()
repositories { jcenter() }
}
dependencies {
classpath("org.springframework.boot:spring-boot-gradle-plugin:${springBootVersion}")
}
}