Antu Jilson

Data Engineer with 3+ years of experience at UST building scalable ETL/ELT pipelines, real-time data integrations and enterprise data platforms on Microsoft Azure. Strong hands-on expertise in Azure Databricks, PySpark, Azure Data Factory, Azure Synapse Analytics, Delta Lake, Apache Kafka, Python and SQL. Delivered 10+ production integration interfaces for a large US retail client (Albertsons Safeway), cut data loss by 99%, reduced data inconsistencies by 95% and sustained 99.5%+ uptime.

Recognized with the Excellence Award (2025) and Rising Star Award (2024).

Seeking Data

Engineer / Azure Data Engineer roles.

Software Engineer A2 (Data Engineer) at UST (2023-03 – Present)

Client: Albertsons Safeway (Retail)

• Designed, developed and deployed 10+ enterprise data integration interfaces and 40+ production notebooks using Azure Databricks, PySpark and Azure Data Factory.
• Built ETL/ELT pipelines on Medallion Architecture (Bronze, Silver, Gold) with Delta Lake and ADLS Gen2, enabling reliable, analytics-ready data.
• Reduced data loss by 99% and maintained 99.5%+ pipeline uptime across production workloads.
• Implemented Kafka-based real-time vendor data synchronization with sub-second latency.
• Developed reusable PySpark UDF frameworks, improving processing performance by 40%.
• Built data quality validation frameworks that reduced data inconsistencies by 95%.
• Integrated source and target systems through REST APIs and FBDI (File-Based Data Import); managed secrets securely with Azure Key Vault.
• Used Git/GitHub and CI/CD practices for version control and deployment; collaborated with cross-functional teams in an Agile environment.

Master of Computer Applications in MCA – Amal Jyothi College of Engineering, APJ Abdul Kalam Technological University (2022)

B.Sc. in Electronics with Computer Technology – Mar Augusthinose College, Mahatma Gandhi University (2019)