Pinned Loading

1. walmart-sales-analytics-snowflake-dbt walmart-sales-analytics-snowflake-dbt Public

   End-to-end data engineering project using AWS S3, Snowflake, and dbt to implement Medallion Architecture with SCD Type 1 & Type 2 logic on Walmart sales data, followed by analytical visualizations …

   Python

2. aws-serverless-data-lake-nurse-staffing-pipeline aws-serverless-data-lake-nurse-staffing-pipeline Public

   End-to-end serverless data pipeline on AWS that ingests healthcare staffing data from Google Drive, processes it through a multi-layer data lake (raw → refined → curated), enforces data quality, an…

   Jupyter Notebook

3. real-time-data-pipeline-aws-snowflake real-time-data-pipeline-aws-snowflake Public

   Production-style real-time data ingestion pipeline built with AWS and Snowflake, featuring pre-stream validation, fault isolation, and automated Snowpipe ingestion.

   Python

4. aws-glue-snowflake-dbt-pipeline aws-glue-snowflake-dbt-pipeline Public

   Modern batch data pipeline using AWS Glue, S3, Snowflake, and dbt. Showcases secure ingestion, external stages, layered transformations, dbt testing, and production deployment with environment sepa…

   Python

5. containerized-lambda-cicd-data-ingestion containerized-lambda-cicd-data-ingestion Public

   A containerized AWS Lambda data ingestion pipeline with automated CI/CD using GitHub and AWS CodeBuild, extracting data from the Calendly API and storing it in Amazon S3

   Python

6. airflow-snowflake-healthcare-pipeline airflow-snowflake-healthcare-pipeline Public

   Production-style data pipeline built with AWS MWAA (Apache Airflow) and Snowflake, implementing a Bronze–Silver–Gold architecture. Orchestrates parallel ingestion of healthcare CSV data from S3 int…

   Python