Harshitha Gp

Data Engineer with 3+ years of experience taking REST API integrations from source investigation and schema design to reliable production pipelines. Contributed to 95%+ service uptime and approximately 95% on-time delivery through pipeline optimization and incident resolution.

Combines

Python, SQL, PySpark, and Databricks with data modeling and incident ownership to deliver dependable, analytics-ready datasets.

Data Engineer - ADA Digital Analytics Pvt Ltd

(2023-09)

• Built 25+ API integrations, covering source investigation, ETL/ELT ingestion, transformation, schema mapping, validation, and production release.
• Implemented API authentication and customer-specific configurations, validating source behavior through Postman testing with dedicated test accounts and sample records; used API documentation to define integration logic when test data was unavailable.
• Designed analytical schemas and ERDs, normalizing nested payloads and defining primary/foreign keys to reduce redundancy; configured cursor-, page-, and offset-based pagination, batching, retries, and rate-limit handling.
• Delivered customer-requested tables, fields, report exports, and webhooks; coordinated new capabilities with product and Java/Clojure framework teams and escalated infrastructure failures with diagnostic findings.
• Enhanced incremental batch pipelines with timestamp-based change data capture (CDC) to capture record-level updates and prevent data gaps in API-to-warehouse synchronization.
• Reduced job execution time by 40% and compute costs by $400/month by optimizing PySpark and SQL transformations and Spark/Delta Lake workloads in Databricks.
• Focused primarily on production incident resolution over the past 2 years, resolving 50+ incidents per month through API diagnostics, root-cause analysis, and structured triage; reduced P1 mean time to resolution (MTTR) by 80%.
• Reconciled API responses with Snowflake and BigQuery tables using SQL to diagnose missing records, duplicates, and null primary keys and validate corrective fixes.
• Contributed to 95%+ service uptime and approximately 95% on-time delivery across supported services; monitored services with 500+ customer connections and resolved sync delays, expired pagination tokens, and authorization failures.
• Developed 2 AI-assisted engineering tools for API endpoint identification and Clojure connector-code generation, and definition checks against documentation and predefined rules, with human validation before merge.

B.E. - Computer Science and Engineering - SJB Institute of Technology (2019 - 2023)