Amisha Arya

Data Engineer with 5+ years of experience in Python, PySpark, and SQL, building ETL pipelines and data platforms across Azure Databricks and Azure Data Factory. Worked across product data syndication and global retail domains, with hands-on experience in Medallion architecture, incremental loading, and multi-client data integrations. Looking to take on more complex data engineering challenges.

Senior Engineer at Marx Enterprise Transformation Architecture (2024-08 – 2026-03)

• Built ETL pipelines using Databricks, PySpark, SQL, and Azure Data Factory, processing ~500GB of daily product data for product syndication and SAP module ingestion.
• Consolidated product data from multiple sources and designed data models supporting country-specific product variations across global retail datasets.
• Implemented Slowly Changing Dimensions (Type 1 & Type 2) to maintain historical product attributes for downstream analytics.
• Structured pipelines using Medallion architecture and partitioning to improve query performance and data retrieval speed.
• Managed deployments using Databricks Asset Bundles and Git, ensuring consistent releases across environments.
• Implemented alerts to detect and respond to pipeline failures.

Data Engineer at Productsup (2021-04 – 2024-07)

• Built PySpark ETL jobs using Databricks and ADF to distribute product data feed (XML, JSON) from REST APIs/SFTP/ADLS for multi-channel product distribution.
• Parsed complex product schemas including BMECat XML, applying schema enforcement and type casting.
• Implemented delta and incremental load patterns using ADF and SQL Server to syndicate only new and changed product records to partner platforms.
• Designed configurable, metadata-driven ADF pipeline templates enabling reuse across multiple client integrations.
• Applied channel-specific validation rules to reject non-conforming product records before syndication.
• Delivered syndication-ready datasets from Azure SQL consumed by Qlik for product performance reporting.
• Maintained code quality using pytest and mypy within Git-based CI pipelines; used Docker for local development.

Web Developer at Deorwine Infotech (2019-08 – 2021-03)

• Developed web applications using Laravel and Django, building REST and GraphQL APIs from development to production.
• Implemented frontend features with Vue.js, including real-time chat functionality.
• Optimized MySQL queries and schema design to improve application performance.
• Integrated third-party APIs including Facebook, Google, Twitter, and PayPal for authentication and payments.
• Deployed applications on AWS and managed version control using Git.

MCA – Rajasthan Technical University, Kota (2019)

BCA – Sophia College, Ajmer (2017)