Skip to main content
Rao K

Rao K

Senior Data Engineer

Talent
PlanoMember since July 27, 2026
DatabricksApache SparkMedallion architectureData lakehouse designETL/ELT pipeline developmentAWS LambdaAWS GlueAzure StackServerless data processingAPI connectorsNative connectorsChange Data Capture (CDC)DBTData warehouse architectureSemantic data modelsKnowledge graphsOntology-driven frameworksTalend Data CatalogueData stewardshipMaster data managementPower BISSRSTableauQlikViewAWS QuicksightPostgreSQLSQL ServerOracleMongoDBSnowflake
·

Hire this person

Send a job offer directly to this candidate

DatabricksApache SparkMedallion architectureData lakehouse designETL/ELT pipeline development

About

Senior Data Engineer with 18+ years of experience designing and building scalable enterprise data pipelines and lakehouse solutions. Expert in Databricks pipeline development, medallion architecture implementation, and catalog migration strategies on AWS and Azure cloud platforms. Led enterprise platform modernization initiatives delivering data fabric implementations and governed data solutions for Fortune 500 organizations, resulting in standardized cross-platform data structures and 100% reporting continuity during migrations.

Proven ability to architect production-grade data ingestion frameworks, mentor engineering teams, and translate complex business requirements into sustainable technical solutions aligned with enterprise data governance standards.

Experience

Senior Data Engineer – Platform Modernization - Impetus - Plano, TX

  • Architected and deployed Databricks pipeline solutions for Fortune 500 life sciences and financial clients, building production-grade data ingestion frameworks supporting multi-system integrations across North America and Australia
  • Designed and implemented medallion architecture patterns for data lakehouse consolidation, improving data quality governance and scalability across enterprise data platforms on Azure Stack and AWS
  • Led catalog migration strategy and execution for legacy ETL to Databricks migration, establishing governed data definitions and semantic layer frameworks ensuring 100% data continuity and cross-platform standardization
  • Designed Change Data Capture (CDC) model implementations for platform modernization project, standardizing data structures and change handling semantics across 3+ enterprise platforms
  • Migrated HD Insights and Talend ETL workloads to Databricks, consolidating 50+ Power BI reports and dashboards to lakehouse architecture while maintaining reporting continuity and SLA compliance
  • Orchestrated ETL/ELT replatforming from legacy tools (Informatica, Cognos) to AWS Glue and AWS Quicksight, directing discovery workshops and translating complex business requirements into scalable migration roadmaps
  • Partnered with cross-functional teams to define migration strategies, governance frameworks, and technical scope of engagements supporting 5+ enterprise platform modernization initiatives
  • Mentored technical teams through architecture guidance and code reviews, establishing best practices for production-grade data pipeline development and lakehouse implementation patterns

Data Engineer / Solution Architect – Talend & Data Governance - Talend Inc - Plano, TX

(2019-10 - 2023-12)

  • Architected and demonstrated enterprise data integration solutions using Talend ETL (traditional and big data), Talend Stewardship, and Talend Data Catalogue, translating customer requirements into tailored platform solutions
  • Designed data governance communication frameworks and literacy programs for 10+ enterprise customers, establishing master data management principles and data stewardship best practices
  • Led product management functions for Talend Data Catalog, partnering with development teams to prioritize 25+ feature requests from customer feedback, ensuring timely implementation and product-market alignment
  • Conducted technical workshops and product training sessions for C-suite and technical audiences, demonstrating platform capabilities and driving customer adoption of data governance frameworks
  • Supported post-sales implementation transitions and provided ongoing technical guidance throughout customer engagement lifecycle, ensuring seamless solution adoption

Data Engineer / Architect – Cloud Migration & Transformation - British Petroleum - Houston, TX

(2018-01 - 2019-10)

  • Executed AWS cloud migration strategy for 15+ legacy IST applications, performing pre-migration assessments and complexity analysis using AWS Migration Accelerator
  • Developed enterprise data migration pipelines using Informatica Power Center (Source Analyzer, Target Analyzer, Mapping, Mapplet) for multi-language applications (Dot Net, Java) backed by SQL Server, Oracle, and Postgres databases
  • Implemented database conversion framework migrating Oracle to PostgreSQL using AWS Services (Schema Conversion Tool, Database Migration Service), establishing cloud-native data architecture patterns
  • Designed and validated migration roadmaps supporting cloud transformation team strategy, ensuring application continuity and data integrity across hybrid cloud environments

Data Engineer - West Corporation - Omaha, NE

(2016-01 - 2017-12)

  • Developed enterprise data warehouse and reporting infrastructure for Brickhouse project, delivering 30+ dashboards and reports using Power BI, SSRS, and Tableau
  • Designed and reverse-engineered physical data models, establishing baseline architectural artifacts and documentation for 8+ application domains
  • Built and optimized ETL pipelines using Pentaho Kettle and SSIS for ad-hoc business requirements, supporting 15+ concurrent data integration workloads
  • Architected and deployed MongoDB cluster infrastructure, managing 2+ petabytes of distributed data across production environments
  • Implemented PostgreSQL database administration function, managing schema design, performance tuning, and backup/recovery procedures for 12+ business-critical databases
  • Developed proof-of-concept integration between Pentaho ETL and Apache Kafka, validating streaming data architecture patterns for next-generation analytics platform

Data Architect - State Farm Insurance - Bloomington, IL

(2012-08 - 2015-12)

  • Designed enterprise Customer Driven platform solution architecture, delivering data modeling and database solutions supporting 20+ business initiatives
  • Developed relational and NoSQL data models using ERStudio, implementing complex data architectures for Master Data Management and Data Governance programs
  • Created 40+ analytical reports and dashboards using Power BI, SSRS, Tableau, and QlikView, supporting executive decision-making across 5+ business units
  • Developed SSIS ETL jobs supporting data migration and Master Data Management initiatives, processing 500+ million records monthly
  • Served as escalation subject matter expert for database performance issues, providing technical leadership to program-level triage activities
  • Facilitated enterprise data architecture SOW initiatives for Master Data Management, Data Governance, Data Migration, and NoSQL data modeling as part-time Scrum Master

BI Project Lead - Swank Health Care - St. Louis, MO

(2011-09 - 2012-08)

  • Designed and built enterprise data warehouse supporting non-theater distribution channel data consolidation from 6+ source systems
  • Developed ETL pipelines using SSIS and Pentaho Kettle, processing 100+ million distribution records daily
  • Created 25+ analytical reports and dashboards using Power BI and SSRS for business stakeholder decision-making
  • Developed web-based reporting portal using Microsoft ASP.NET and C#, enabling self-service analytics access for 500+ users

Project Lead – Business Intelligence Solutions - THR Associates - Springfield, IL

(2012-01 - 2011-09)

  • Architected enterprise BI solution stack using Microsoft BI platform (SSRS, SSIS, SSAS), supporting data warehousing and advanced analytics initiatives
  • Designed dimensional data models and SSAS cubes supporting 8+ analytical business domains

Education

Bachelor - Electronics & Communications - VTU

Skills

Senior Data Engineer

Reviews

Related