Different ways to work with Azure Data Factory introduces the working model for Azure Data Factory: factories, pipelines, activities, connections, datasets, triggers, and monitoring. This post is ...
Reference Bookmark from the original Notion lesson Overview: Want to copy a file from one folder to another folder using copy activity in ADF. Create Storage Account and a Container ...
Some of the Top Level Concepts that we need to understand when working with Azure Data Factory are: - Pipeline Activity Datasets an Linked Services ...
Azure Data Factory is an Azure Service for ETL (Extract, Transform and Load) operations. Source Based on my Notion lesson page: 1. Introduction to Azure Data Factory.
AWS Glue is a serverless data integration service for discovering, preparing, transforming, and moving data. It is commonly used in data lake pipelines where raw files land in Amazon S3, metadata i...
AWS Lambda is a serverless compute service that lets us run code without provisioning or managing servers. We write a function, configure how it should be invoked, give it permissions through IAM, ...
Amazon RDS, short for Amazon Relational Database Service, is AWS’s managed service for running relational databases in the cloud. Instead of installing database software on an EC2 instance and mana...
Amazon S3, short for Simple Storage Service, is one of the most foundational AWS services. Along with services like EC2 and Lambda, S3 shows up in almost every real cloud architecture because appli...
Amazon EC2, short for Elastic Compute Cloud, is the AWS service used to create and manage virtual servers in the cloud. In a traditional data center, applications usually run on physical servers ow...
Cloud computing has fundamentally changed how modern applications are built, deployed, and scaled. Before jumping into building on AWS, it is crucial to understand the foundational concepts — what ...