Rachana Kampli

AWS Data Engineer with 3+ years of experience building scalable ETL/ELT data pipelines, real-time streaming architectures, and cloud-native data solutions using AWS services including Redshift, Glue, Lambda, Kinesis, S3, DynamoDB, and Airflow. AWS Certified Data Engineer - Associate with hands-on expertise in data warehousing, SQL optimization, workflow orchestration, and cloud migration across oil & gas, e-commerce, and financial services domains.

Senior Data Engineer at Cloudthat Technologies (2023-01 – Present)

• Designed and implemented end-to-end ETL/ELT data pipelines on AWS (Glue, S3, Redshift, Lambda) for batch and real-time ingestion across oil & gas, e-commerce, and financial analytics domains.
• Orchestrated data workflows using Apache Airflow (DAGs), reducing manual pipeline intervention by ~40% and improving reliability and on-time data delivery.
• Built real-time streaming pipelines using Amazon Kinesis Data Streams and DynamoDB; processed large-scale datasets with Amazon EMR and optimized Redshift queries for high-performance analytics.
• Led cloud data migration from Amazon RDS to Redshift using AWS DMS, ensuring schema integrity, full data consistency, and minimal downtime.
• Built serverless, event-driven data automation using AWS Lambda and boto3, improving system efficiency and pipeline reliability.
• Delivered interactive BI dashboards and data warehouse solutions using Amazon QuickSight, with optimized SQL queries supporting analytics, reporting, and client-facing decision-making.
• Built scalable web scraping pipelines using Python and Selenium to extract and validate product data from multiple sources, implementing batch processing and error-handling for high data accuracy.

BE in Information Science and Engineering – Gogte Institute of Technology, Belgaum (2018-08 – 2022-09)