⚡ Incremental data ingestion from Neon PostgreSQL into Databricks Bronze · Lakeflow Connect — Ingestion Pipeline · No ETL code · Auto checkpoint · Fault tolerant

Delarative pipeline demo in databricks, source data from s3 external location, incremental refresh using streaming table

RideStream is a scalable Azure-based lakehouse project designed for ride-hailing analytics. It combines batch ingestion from HTTP/internal sources with streaming booking events from Event Hubs, processes them in Databricks, and delivers a clean analytics model through a silver-layer OBT and a gold-layer star schema.