Skip to main content

Practice Lead – Data Engineering & AI (Python, Databricks, Cloud)

Technology
PERSOL APAC
2 weeks agoUntil 06/06/2026
Full timeOn-site

Job description

We are seeking a high-impact Practice Lead – Data Engineering & AI to build, lead, and scale a modern cloud data platform consulting practice, with a strong focus on Databricks Lakehouse and Python-based data engineering.

This role requires a combination of business leadership, client engagement, and deep technical expertise, with proven experience in delivering large-scale enterprise data platforms.

Role & Responsibilities

  • Build and scale the Data Engineering & AI practice (Databricks-first approach) and define service offerings across:
  • Data Platform Modernization (Lakehouse)
  • Data Engineering (batch & streaming)
  • AI/ML enablement using Python ecosystems
  • Lead client engagements, RFPs, and solution architecture, driving consultative selling of modern data platforms
  • Provide technical leadership across:
  • Databricks implementations and Lakehouse architecture
  • Python-based data pipelines (PySpark, APIs)
  • Real-time data processing platforms
  • Ensure best practices in scalability, performance, cost optimization, and data governance
  • Build and mentor high-performing teams including Data Engineers, Data Architects, and ML Engineers, and establish onshore + offshore delivery models
  • Own practice P&L, revenue growth, pricing strategy, and utilization, while optimizing delivery through offshore leverage
  • Drive capability development, certifications (Databricks, Azure/AWS), and continuous improvement across the practice

Requirements:

12–18+ years of experience in Data Engineering / Data Platforms, with 5+ years in leadership roles

Strong hands-on expertise in:

  • Python (PySpark, Pandas, APIs)
  • Databricks (Lakehouse, Delta Lake, workflows)
  • ETL/ELT pipelines and real-time streaming (Kafka / Spark Streaming)
Experience with cloud platforms (Azure preferred / AWS / GCP) and data storage (ADLS / S3)

Familiarity with orchestration tools (ADF, Airflow) and data platform DevOps practices

Strong understanding of data architecture, scalability, performance, and cost optimization

Proven experience working with enterprise clients (BFSI preferred)

Ability to engage senior stakeholders (CDO, CTO, Head of Data) and drive consultative discussions

Experience in practice building, P&L ownership, and scaling teams (0 → 50+ resources)

PERSOL Singapore Pte Ltd • RCB No. 200007268E

EA License No. 01C4394 • EA Registration No. R1113321 (Jacob Tijo)

Keywords
policies-and-practicesdata-engineeringartificial-intelligencepythonazure-databricksdatabrickscustomer-engagementdata-platformdata-lakehousemachine-learningdata-pipelinepysparktime-and-attendancereal-time-datadata-processingreal-time-data-processingscalabilityexpense-optimizationdata-governancementoringsales-growthpricingtraining-and-developmenttraining-certificationmicrosoft-azureamazon-web-servicescontinuous-improvement-process-cippandasdelta-lakeextract-transform-and-load-etlelectronic-titleextract-load-transform-eltkafkasparkapache-spark-streaminggoogle-cloud-platformgood-clinical-practice-gcpdistribution-and-storagedata-storageamazon-s3service-management-and-orchestration-smoairflowapache-airflowdevelopment-operations-devopsdata-architecturecollateralized-debt-obligations-cdoeye-face-and-headyouth-organizations-resourcesenterprise-architecture

¿Te interesa este puesto?