Skip to content

Instantly share code, notes, and snippets.

View scho's full-sized avatar

Georg Meyer scho

View GitHub Profile
@dobesv
dobesv / JacksonMapper.java
Created October 29, 2015 00:59
Use jackson to map jdbi beans
package caltrac.db;
import java.sql.ResultSet;
import java.sql.ResultSetMetaData;
import java.sql.SQLException;
import java.util.HashMap;
import java.util.Map;
import org.skife.jdbi.v2.StatementContext;
import org.skife.jdbi.v2.tweak.ResultSetMapper;
@scottpersinger
scottpersinger / gist:e038ddc7c094c14bde0a
Last active November 23, 2023 04:34
Node-based ETL pipeline

Node.js offers a great environment for building ETL scripts. This is because Node is very easy to program and work with, AND has interface libraries for almost everything under the sun.

We need a framework that makes writing ETL scripts easy:

  • Supports creation and re-use of components
  • Cleanly divides input/output concerns from transformation concerns
  • Works identically in both event-driven and batch scenarios
  • Supports an easy development/testing mode
  • Provides good visibility when running in production
  • Has a simple DSL for expressing transformation logic