About

Data Engineer with 9+ years of overall professional experience and a focus on building data pipelines, data integration and analytics-ready datasets. Skilled in SQL, Python, PySpark, Azure Data Factory, Azure Databricks, ADLS Gen2 and Delta Lake.

Experience2

1. UC

   Data Engineer

   Apr 2021 — Present

   Udayan Care · New Delhi

   Designed and orchestrated ETL/ELT pipelines using Azure Data Factory (ADF) and PySpark on Azure Databricks, processing data for 5,000+ learners across 20+ centres. Built Delta Lake tables using Bronze, Silver and Gold layers to create analytics-ready datasets, reducing data processing time by 45%. Automated ingestion from 10+ source systems into ADLS Gen2, reducing manual data consolidation effort by 60%. Developed SQL queries and PySpark transformations for data cleaning, validation and consolidation, improving data accuracy by 30%.

   • Reduced data processing time by 45%
   • Reduced manual data consolidation effort by 60%
   • Improved data accuracy by 30%
   • Reduced data discrepancies by 35%
   • Reduced report turnaround from 3 days to same-day delivery
2. PT

   Data Analyst

   Jan 2017 — Mar 2021

   Purple Tree Pvt. Ltd. · New Delhi

   Extracted, cleaned and analyzed operational data using SQL and Python, maintaining 99% data accuracy across recurring reports. Built and maintained 10+ Power BI dashboards to provide stakeholders with visibility into operational metrics. Automated recurring reporting workflows using Excel, SQL and Python, reducing manual reporting time by 50%.

   • Maintained 99% data accuracy across recurring reports
   • Reduced manual reporting time by 50%
   • Identified and resolved 200+ monthly data discrepancies

Projects1

• HealthLake360 Healthcare Lakehouse Platform

  Developing an enterprise-style data engineering project using synthetic healthcare datasets and Databricks Free Edition.

Education1

• DU

  B.A.

  2022 — 2016

  Delhi University