Create your free profile

About

Results-driven Data Engineer with ~4.6 years of overall experience, including 3+ years of experience in Data Engineering, designing and optimizing scalable ETL/ELT pipelines using PySpark, Apache Spark, Databricks, and Azure Data Factory. Proven expertise in Delta Lake, Medallion Architecture (Bronze/Silver/Gold), Unity Catalog, and big data processing on Azure cloud.

Experience4

  1. Data Engineer

    Jun 2025 — Present

    Arbre Creations Private Limited

    Designed and orchestrated data pipelines in Azure Data Factory (ADF) to automate ingestion of multiple data sources into Azure SQL Database and ADLS Gen2. Engineered PySpark transformations in Azure Databricks to clean and enrich raw data across 5+ source systems. Developed and optimized SQL queries, stored procedures, and views, reducing report generation time by 25%. Streamlined workflows and data validation checks using PySpark and Python, minimizing manual intervention and lowering error rates by 15–20%.

    • Reduced manual load effort by 20%
    • Improved data accuracy by 15%
    • Reduced report generation time by 25%
    • Maintained 95%+ data accuracy
    • Cut pipeline run time by 30%
    • Improved reporting turnaround time by 20%

  2. Associate Data Engineer

    Jun 2023 — May 2025

    Allocate Software India Pvt Ltd

    Built and configured Azure Data Factory (ADF) pipelines to ingest data from multiple sources including CSV, JSON, and SQL databases into ADLS Gen2 and Azure SQL Database. Engineered PySpark transformations in Azure Databricks for data cleansing, validation, and standardization of patient and operational datasets spanning 15+ hospital data feeds. Authored and tuned SQL queries, views, and stored procedures to support business reporting and healthcare analytics requirements.

  3. Software Developer

    Feb 2022 — Jun 2023

    Deepraj Software Services Pvt Ltd

    Developed and supported backend applications and data processing modules for core business operations. Processed large-scale datasets across DAM, GDAM, TAM, GTAM, RTM, and REC systems handling 200K+ records. Optimized SQL queries, stored procedures, and database objects, boosting application performance and data retrieval efficiency.

    • Boosted application performance and data retrieval efficiency by 40%

  4. Intern

    Aug 2021 — Jan 2022

    Defence Research and Development Organisation (DRDO)

    Developed data processing components supporting efficient handling of 50K+ operational records. Performed data validation, query optimization, and data management activities on MySQL databases. Improved database performance and data quality through indexing and query tuning.

    • Cut query response time by 20%

Projects2

  • Sales & Marketing Analytics Pipeline

    Designed and implemented an end-to-end Medallion Architecture (Bronze/Silver/Gold) on Azure Databricks to process 500K+ daily sales and marketing records from multiple source systems.

    • Databricks
    • PySpark
    • Azure Data Factory
    • Delta Lake

  • Healthcare Patient Data Pipeline

    Built a HIPAA-compliant patient data processing pipeline on Azure Databricks handling 10K+ daily patient records from hospital EHR systems using PySpark and ADF.

    • PySpark
    • Databricks
    • ADF
    • Delta Lake
    • ADLS Gen2

Education3

  • B.Tech

    2017 — 2021

    Dr A P J Abdul Kalam Technical University, Lucknow

    Information Technology

  • Intermediate

    2016 — 2017

    SSD Boys Inter College, Meerut

    PCM

  • High School

    2014 — 2015

    CRK High School, Meerut

    PCM

Certifications2

  • Microsoft Certified: Azure Data Fundamentals (DP-900)

  • Power BI Data Analyst Associate

    Microsoft