Nisha Sorallikar
Data Engineer | AWS | Azure | PySpark | Databricks | SQL | ETL
Hire this person
Send a job offer directly to this candidate
About
Associate Data Engineer with 2+ years of hands-on experience at Cynosure Software Solutions designing and building end-to-end data pipelines on AWS using the Medallion Architecture (Bronze / Silver / Gold). Proficient in Python, SQL, and PySpark, with practical expertise across Amazon S3, AWS Glue, Databricks, Delta Lake, Athena, and Redshift. Experienced in developing metadata-driven ingestion frameworks, Change Data Capture (CDC), and SCD Type 2 workflows while operating in Agile Scrum teams to deliver scalable, analytics-ready datasets.
Experience
Associate Data Engineer at Cynosure Software Solutions Pvt. Ltd. (2025-02 – Present)
- Built an end-to-end Lakehouse platform on Amazon S3 and Databricks using Medallion Architecture with Bronze, Silver, and Gold layers, processing 10M+ records/day across ERP and manufacturing datasets.
- Developed a metadata-driven ingestion framework using AWS Glue and PySpark to standardize ingestion and simplify onboarding of multiple datasets.
- Implemented CDC pipelines with SCD Type 2 logic using Delta Lake MERGE INTO, while applying data cleansing and validation to maintain accurate historical dimension records.
- Optimized Spark workloads using partitioning, caching, efficient joins, and transformation optimization, improving processing performance by approximately 30–50%.
- Developed PySpark pipelines for cleansing, joining, aggregating, and transforming supply chain datasets, including handling of late-arriving data.
- Designed Gold-layer fact and dimension tables using a star schema for inventory, demand, stock, and lead-time analytics.
- Engineered KPI calculation and aggregation workflows to track critical supply chain metrics, preparing analytics-ready datasets for Power BI dashboards.
- Orchestrated production batch workflows using Apache Airflow (MWAA) and AWS Step Functions with dependency management and scheduled execution.
- Optimized PySpark joins and aggregations to improve processing efficiency and reduce pipeline latency.
Data Engineer Intern at Cynosure Software Solutions Pvt. Ltd. (2024-07 – 2025-02)
- Supported the development of AWS data pipelines by writing PySpark and SQL transformations for data cleansing, validation, and de-duplication under senior engineer guidance.
- Assisted with data-quality checks, S3 data-lake organization, and AWS Glue Data Catalog maintenance for ingestion workflows.
- Participated in Scrum ceremonies and used Jira and Git/GitHub for task tracking and version control.
Education
Bachelor of Computer Applications in BCA – Gulbarga University (2025)
