Skip to content
#

dynamic-pipelines-in-adf

Star

Here is 1 public repository matching this topic...

neha-dev-dot / NYC-TAXI

Star 1

This repository contains a complete end-to-end real-time data engineering project built using Azure Data Factory, Databricks, Delta Lake, and Azure Data Lake Storage. It demonstrates how to dynamically ingest data from public APIs (NYC Taxi Dataset), process it using PySpark, and structure it using the Medallion Architecture (Bronze, Silver, Gold )

real-time-api-ingestion dynamic-pipelines-in-adf pyspark-transformations-in-databricks delta-lake-with-versioning data-ready-for-analytics
  • Updated Jul 5, 2025
  • Python

Improve this page

Add a description, image, and links to the dynamic-pipelines-in-adf topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the dynamic-pipelines-in-adf topic, visit your repo's landing page and select "manage topics."

Learn more