Write Cache Sink to Activity Output in ADF is one lesson in the broader Azure Data Factory series, focused on turning ADF from a collection of screens into a practical data integration workflow. T...
Session Log in Copy Activity covers the most common ADF data movement pattern: reading from a source, applying copy settings, and landing the result in a destination with monitoring around throughp...
Cache Sink and Cached Lookup in Mapping Data Flow in ADF belongs to the visual transformation side of ADF. Mapping Data Flows provide Spark-backed transformations without requiring every step to be...
Rank Transformation in Mapping Data Flow in ADF belongs to the visual transformation side of ADF. Mapping Data Flows provide Spark-backed transformations without requiring every step to be hand-cod...
Global Parameters in ADF is about making a pipeline reusable. Parameters and variables let the same pipeline adapt to different files, tables, dates, environments, and branches of execution. This ...
Templates Overview in ADF is one lesson in the broader Azure Data Factory series, focused on turning ADF from a collection of screens into a practical data integration workflow. This post is part ...
Annotations in ADF is one lesson in the broader Azure Data Factory series, focused on turning ADF from a collection of screens into a practical data integration workflow. This post is part of my A...
How to read JSON output of one Activity in to another Activity in ADF is one lesson in the broader Azure Data Factory series, focused on turning ADF from a collection of screens into a practical da...
Continuous Integration and Deployment in ADF covers how ADF projects are authored, versioned, reviewed, and promoted between environments. This post is part of my Azure Data Factory tutorial notes...
Use Azure Key Vault Secrets in ADF focuses on safer secret management. Production ADF pipelines should avoid hard-coded secrets and pull credentials from a controlled secret store. This post is pa...