Create your free profile

About

Senior Data Engineer with 8 years of experience delivering reliable batch and real-time data products across cloud and enterprise platforms. Deep hands-on expertise in Apache Spark / PySpark, Spark Structured Streaming, Kafka, MongoDB, REST API integrations, SQL, Informatica, and AWS.

Experience2

  1. Data Engineer

    Apr 2022 — Present

    Ernst & Young · Gurgaon

    Serve as a senior contributor and technical lead for Spark-based data engineering workstreams, guiding design decisions, reviewing PySpark and SQL code, and supporting engineers through delivery and production issues. Architect and deliver end-to-end batch and near-real-time pipelines using PySpark, AWS, Kafka, and SQL, enabling scalable ingestion, transformation, and consumption of business-critical data.

    • Optimized long-running Spark jobs by 70% through partitioning, query optimization, and resource-aware processing.
    • Established data-quality controls, reconciliation checks, monitoring, and incident triage practices that improve trust in datasets.

  2. ETL Developer

    Nov 2018 — Mar 2022

    Cognizant Technology Solutions · Pune

    Developed end-to-end ETL mappings using Informatica PowerCenter and SQL for enterprise data warehouse programs across heterogeneous source systems. Built reusable, parameterized ETL workflows supporting robust scheduling, incremental loads, and scalable delivery across multiple data domains.

    • Delivered a Python-based data-quality framework for profiling, rule validation, automated reporting, and scorecards that improved visibility into data health.

Education1

  • Bachelor of Technology

    2014 — 2018

    Guru Gobind Singh Indraprastha University

    Electronics and Communication

Certifications1

  • Databricks Certified Data Engineer Associate