Damini Rana

Senior Data Engineer with 7 years of experience architecting and building scalable cloud-native data platforms across healthcare and insurance domains. Proven expertise in AWS, PySpark, Apache Spark, SQL, Snowflake, and Informatica, designing high-performance batch and real-time ETL pipelines processing millions of records daily. Experienced in metadata-driven architectures, schema evolution, distributed data processing, cloud automation, reliability, scalability, and performance optimization.

Claude Certified

Architect with a strong focus on building secure, scalable, and AI-ready data platforms that enable analytics and data-driven decision-making.

Senior Engineer – Cloud & Data Tech at Fractal Analytics (2022-08 – Present)

• Architected and delivered 25+ cloud-native ETL pipelines using AWS Glue, PySpark, Lambda, Step Functions, EMR, Amazon S3, and Redshift, processing 10M+ records daily with 99.9% pipeline availability.
• Led end-to-end integration of an enterprise document management platform with AWS using AWS Glue, Lambda, API Gateway, Python, and Amazon S3, enabling secure, event-driven data ingestion and synchronization.
• Built REST API integrations using AWS API Gateway and Python Lambda to automate document ingestion, metadata extraction, and event-driven workflows, reducing manual effort by 70% and turnaround time by 60%.
• Engineered scalable PySpark frameworks to transform complex XML datasets into parquet, improving downstream query performance by 45%.
• Developed metadata-driven ETL frameworks supporting schema evolution, dynamic mapping, incremental loading, and idempotent processing, enabling resilient pipelines with automated quarantine and reprocessing of invalid records.
• Implemented real-time event-driven pipelines using Amazon SQS, Lambda, API Gateway, and Step Functions, enabling low-latency processing for enterprise business workflows.
• Automated data validation and reconciliation using PySpark, REST APIs, Amazon S3, and GitHub Actions, achieving 99.8% data accuracy while eliminating manual validation.
• Optimized Spark and AWS Glue workloads using partition pruning, predicate pushdown, broadcast joins, and Parquet optimization, reducing ETL execution time by 40%.
• Implemented enterprise monitoring, security, and governance using Amazon CloudWatch, CloudTrail, IAM, AWS Secrets Manager, AWS Config, and Lake Formation, ensuring regulatory compliance and reducing incident detection time by 50%.
• Automated infrastructure provisioning and CI/CD using AWS CloudFormation, Jenkins, GitHub Actions, and dbt, reducing deployment effort by 80% while supporting 50+ production releases.

Consultant – Data Engineer at Deloitte Consulting (2022-02 – 2022-07)

• Built and enhanced ETL data pipelines using Informatica, PostgreSQL, Python, AWS Batch, AWS Glue, Lambda, Step Functions, Amazon S3, Redshift, EC2, CloudWatch, and SNS, enabling scalable ingestion and transformation of client data for the Revenue Intellect analytics platform.
• Translated business requirements into technical designs and developed ETL workflows to load data into staging, historical, dimension, and fact tables, supporting Power BI dashboards and enterprise reporting.
• Collaborated with cross-functional stakeholders to deliver technical solutions, ad hoc analysis, and production releases, ensuring documentation, testing, validation, and deployment followed established SDLC processes.

Systems Engineer at Infosys Limited (2019-02 – 2022-01)

• Developed cloud-based ETL pipelines using Informatica Cloud (IICS), SQL, and Snowflake to process real-time financial datasets from XML, CSV, and flat-file sources, enabling trusted reporting and analytics.
• Developed, unit-tested, and debugged ETL jobs using advanced SQL across Oracle and Snowflake, supporting Power BI reporting and enterprise analytics.
• Completed requirement gathering, ETL analysis, and data mapping using SSIS and SSMS, and developed Power BI dashboards, including a Google Play Store analytics project.
• Completed internship focused on requirement gathering, ETL analysis, data mapping, and SQL development using SSIS and SSMS; developed Power BI dashboards including a Google Play Store analytics project.

M.Tech in Software Engineering – BITS Pilani Work Integrated Learning Programmes (2021 – 2023)

B.E. in Computer Science & Engineering – Chitkara University, Chandigarh (2015 – 2019)