Node.js offers a great environment for building ETL scripts. This is because Node is very easy to program and work with, AND has interface libraries for almost everything under the sun.
We need a framework that makes writing ETL scripts easy:
- Supports creation and re-use of components
- Cleanly divides input/output concerns from transformation concerns
- Works identically in both event-driven and batch scenarios
- Supports an easy development/testing mode
- Provides good visibility when running in production
- Has a simple DSL for expressing transformation logic