Maintainable ETLs: Tips for Making Your Pipelines Easier to Support and Extend
Stichfix found a few key practices that help make their ETLs easier to understand, maintain, and extend.
1) Building a chain of simple tasks. 2) Using a workflow management tool. 3) Leveraging SQL where possible. 4) Implementing data quality checks.