Tarun M A
Junior Data Engineer | PySpark • Databricks • ETL Pipelines • SQL • Azure Cloud •Delta Lake
Hire this person
Send a job offer directly to this candidate
About
Final-year Computer Science student with hands-on experience designing, building, and maintaining ETL/ELT data pipelines using PySpark, Databricks, and Delta Lake. Proven ability to extract and transform data from multiple sources (REST APIs, databases), ensure data quality through schema validation and deduplication, write efficient SQL and Python scripts, and monitor pipeline performance. Immediate joiner seeking a Junior Data Engineer role to contribute to data infrastructure and analytics.
Experience
Data Engineer Intern at EssilorLuxottica (2026-01 – Present)
Assisted in designing and maintaining ETL/ELT pipelines on Databricks using PySpark, ingesting structured and semi-structured data from multiple sources into Delta Lake for daily analytics across 3+ teams.
- Assisted in designing and maintaining ETL/ELT pipelines on Databricks using PySpark, ingesting structured and semi-structured data from multiple sources into Delta Lake for daily analytics across 3+ teams.
- Wrote Python scripts and SQL queries for data transformation, type casting, and multi-stage cleansing; ensured data quality through schema validation, null handling, and deduplication — reducing downstream reporting errors.
- Ensured data accuracy and consistency across pipelines by applying Delta Lake ACID transactions and schema enforcement during concurrent pipeline runs.
- Monitored pipeline job execution on Databricks Jobs, troubleshot failures via root cause analysis, and improved overall pipeline reliability; maintained documentation for workflows and processes.
- Collaborated with data analysts and engineers to support reporting needs and integrated data across APIs and cloud platforms.
Education
B.E. in Computer Science (Cyber Security) – Sambhram Institute of Technology, Bangalore (2022-01 – 2026-12)
