About

Data Engineer with 1+ year building, owning and maintaining production ETL/ELT pipelines on Palantir Foundry using PySpark, Spark SQL, Python and SQL. Own 23 datasets end to end, and cut a pipeline's build time from 2 hours to 2 minutes by making it incremental.

Experience2

1. SR

   Data Engineer I

   Jul 2025 — Present

   Swiss Re · Bengaluru

   Own 23 datasets end to end, from ingestion to consumption, and have contributed to 30 datasets and pipelines in Palantir Foundry across raw, transformed and curated layers, including datasets with millions of rows. Made a pipeline incremental, cutting build time from 2 hours to 2 minutes. Implemented incremental ingestion and sync for Facebook Ads data, processing only new and changed records instead of reloading full history. Built automated data quality checks and tests that stop bad data before it reaches downstream consumers.

   • Cut pipeline build time from 2 hours to 2 minutes.
   • Contributed to 30 datasets and pipelines in Palantir Foundry.
2. SR

   Technology Intern

   May 2024 — Jul 2024

   Swiss Re · Internship · Bengaluru

   Built a Travel Dashboard in Foundry showing air and train travel volume, timestamps and CO2 emissions for stakeholders. Developed Spark workflows to clean, transform and combine travel data from multiple sources for downstream analytics.

Projects2

• Serverless Data Quality Pipeline on AWS

  Built an event-driven ETL pipeline with schema, null and duplicate checks that quarantines rejected rows along with the rejection reason.

  Open on github

  • Python
  • pandas
  • SQL
  • Parquet
  • AWS CDK
  • S3
  • Lambda
  • Glue
  • Athena

• Salary Predictor

  Cleaned and analysed developer survey data and shipped a Streamlit app that predicts software developer salaries.

  • Python
  • Pandas
  • Streamlit

Education1

• NI

  B.Tech

  2021 — 2025

  National Institute of Technology (NIT), Rourkela

Certifications1

• Apache Airflow certification