Anil Chowdary

GCP certified Data Engineer with 2.4 years of experience building and maintaining data pipelines. Strong hands-on expertise in Google Cloud Platform (BigQuery, Cloud Storage, Pub/Sub, Composer), Airflow, AtScale, Python, and PySpark. Experienced in managing large datasets, automating workflows, and delivering scalable solutions for data processing and analytics.

GCP Data Engineer - Accenture

GCP Data Engineer - Project 1 - Accenture

Enterprise Data and Analytics - Pharma

• Analysis and Logical understanding on the user requirements.
• Development of the views, stored procedures and tables as per user requirement in GCP BIGQUERY.
• Improved pipeline reliability by implementing retry logic, alerts, and SLA monitoring in Cloud Compose.
• Automated data transformation jobs using Python, Airflow, and SQL.
• Collaborated with business teams to enabled insights using AtScale and BigQuery.
• Designed dimensional data models for reporting in AtScale and BigQuery
• Worked on writing SQL Queries that used for preparing the data for Analysis and report.
• Migration of Dags and Codes to production through Jira cards.

GCP Data Engineer - Project 2 - Accenture

Real-Time E-Commerce Analytics Pipeline | Google Cloud Platform

• Simulated real-time user events (views) and streamed them to Pub/Sub using Python.
• Stored raw JSON data in Cloud Storage and used Cloud Composer (Airflow) for batch ETL.
• Developed an Airflow (Cloud Composer) DAG to: Pull messages from Pub/Sub subscription, Store raw data in Cloud Storage (daily folders), Cleanse and transform JSON messages, Load validated data into BigQuery (using star schema)
• Designed star schema and loaded curated data into BigQuery tables for reporting.
• Optimized query performance using partitioning and clustering in BigQuery.

Master of Computer Applications - Vignan's University (2020-01 - 2022-12)