Deepak Chiluveru

Senior Data Engineer with 4+ years of experience designing and implementing enterprise-scale data warehouse and lakehouse solutions using Snowflake, Databricks, and AWS. Expertise in building scalable ETL/ELT pipelines using Python, PySpark, SQL, dbt, and Apache Airflow for processing large-scale structured and semi-structured data. Strong experience in Snowflake architecture including data modelling, performance tuning, RBAC security, cost optimisation, Snowpipe, Streams & Tasks, and scalable cloud ingestion frameworks using AWS S3.

Skilled in dimensional modelling, CDC, SCD Type 2, and developing high-performance analytics solutions for enterprise reporting and business insights. Good exposure to Generative AI, Cortex AI, and RAG-based applications with experience building AI-powered chatbots, intelligent agents, and Streamlit-based conversational analytics solutions integrated with enterprise data platforms. Proficient in SQL, PL/SQL, Oracle Database, and Power BI for delivering scalable, secure, and data-driven solutions.

Senior Data Engineer (Data Engineer II) – Mount Whaleback Mine at SSIGRUN CONSULTANCY PVT LTD (2025-04 – Present)

• Designed and implemented scalable Snowflake-based data warehouse solutions integrating AWS S3 and Oracle sources using ELT methodologies.
• Developed scalable Apache Spark/PySpark ELT pipelines following Agile Scrum.
• Developed reusable transformation pipelines using dbt, Snowflake SQL, and PL/SQL based on Star Schema and Snowflake Schema models.
• Built and maintained automated workflows in Apache Airflow for scheduling, monitoring, validation, and dependency management.
• Utilised Snowpark (Python) for large-scale data processing and advanced transformation logic within Snowflake.
• Performed data modelling, query optimisation, and warehouse tuning to improve performance and optimise Snowflake credit consumption.
• Developed reusable objects and integrated software packages across enterprise data platforms to support scalable analytics solutions.
• Developed Power BI dashboards and analytical reports to support business insights and operational reporting.
• Built AI-powered chatbot and agent solutions using Cortex AI and Streamlit for natural language-based enterprise data interaction.
• Implemented RAG applications by integrating Snowflake enterprise data with LLM capabilities for context-aware intelligent responses.
• Developed Streamlit-based conversational analytics applications enabling business users to access insights without SQL knowledge.
• Identified and resolved data quality, pipeline, and performance issues to ensure data accuracy and system reliability.
• Managed ingestion workflows from AWS S3 into Snowflake using staging frameworks and data lake best practices.
• Implemented Snowflake RBAC security using roles, permissions, and access controls for governance compliance.
• Collaborated with business stakeholders and cross-functional teams to deliver scalable high performance data solutions.

Data Engineer – Kemper DWH at SSIGRUN CONSULTANCY PVT LTD (2023-10 – 2025-03)

• Developed incremental ETL/ELT pipelines to load transformed datasets into Snowflake for enterprise analytics and reporting.
• Utilised Snowpark (Python) for advanced in-platform transformations reducing data movement and improving processing efficiency.
• Built dbt transformation layers to standardise business logic and improve reusability across enterprise datasets.
• Managed workflow orchestration in Apache Airflow including dependency handling, monitoring, scheduling, and failure recovery.
• Integrated Oracle source systems into the warehouse and lakehouse layers with reconciliation and validation mechanisms.
• Developed conversational analytics applications using Streamlit and Cortex AI for simplified user interaction with enterprise data.
• Implemented RAG-based AI solutions combining Snowflake datasets with LLM-powered contextual response generation.
• Improved Snowflake query performance through workload optimisation, warehouse tuning, and efficient query design.
• Created Power BI dashboards and KPI reports to support business analysis and decision-making.
• Managed Snowflake access governance including roles, permissions, grants, and usage monitoring.

Junior Data Engineer at Guardian Life Insurance (GLIC) (2022-07 – 2023-09)

Designed dimensional data models and implemented Snowflake databases with real-time ingestion capabilities.

• Designed dimensional data models using Star Schema and Snowflake Schema methodologies in Snowflake.
• Developed and maintained Snowflake databases, schemas, tables, views, and DDL scripts based on business requirements.
• Loaded large-scale datasets into Snowflake using COPY INTO commands from internal and external stages.
• Implemented Snowpipe for near real-time ingestion from AWS S3 into Snowflake environments.
• Built ingestion pipelines for on-premise and cloud-based data sources ensuring schema validation and consistency.
• Utilised Snowflake Time Travel for data recovery, historical tracking, and debugging purposes.
• Implemented Zero Copy Cloning to create QA and testing environments without additional storage overhead.
• Enabled secure data sharing for external consumers and UAT validation activities.
• Developed Streams and Tasks for CDC processing and implemented SCD Type 2 historical tracking logic.
• Integrated data from Oracle, flat files, and cloud storage platforms into Snowflake environments.
• Performed source-to-target reconciliation, data validation, and cleansing during transformation processes.
• Developed complex SQL queries using analytical and aggregate functions for reporting and analytics.
• Conducted unit testing and integration testing to validate ETL workflows and business logic.
• Maintained technical documentation for development, deployment, and support activities.

B.Tech in Computer Science and Engineering – Kalasalingam Academy of Research and Education (2018-07 – 2022-06)