Skip to main content

Lead Data Engineer

Technology
Techblocks
Gurugram, India₹25,00,000 - ₹34,00,000 /yearYesterday
Full time

Job description

Required Skills & Experience

    • 7 years of experience in Data Engineering, Data Platform Development or related technical roles.
    • Strong hands-on experience with Databricks.
    • Strong programming experience in Python and PySpark.
    • Advanced SQL skills, including complex queries, joins, aggregations and data transformations.
    • Strong experience with Apache Spark and distributed data processing.
    • Hands-on experience designing and developing ETL/ELT pipelines.
    • Experience with REST APIs and API-based data integrations.
    • Working knowledge of Databricks Unity Catalog, including data governance, access management and metadata.
    • Understanding of Delta Lake and lakehouse architecture.
    • Hands on experience in Databricks AI Genie / or any Agentic AI framework.
    • Working knowledge of CI/CD practices and Git-based development workflows.
    • Experience designing governed data pipelines and maintaining enterprise data quality.

Preferred Skills

    • Hands-on experience integrating enterprise data with Planisware.
    • Experience with Databricks Genie and Databricks-based AI/BI capabilities.
    • Experience with LangGraph, LangChain, Semantic Kernel, CrewAI or similar agentic frameworks.
    • Experience building knowledge graphs using Neo4j or other graph technologies.
    • Experience with RAG, vector search and enterprise data retrieval patterns.
    • Experience implementing automated data quality and pipeline monitoring.
    • Exposure to enterprise project portfolio management (PPM), resource management or financial planning datasets.

Keywords
PlaniswareNeo4jApache SparkMetadataPythonSqlApache Http ServerUnityCI/CD

Interested in this role?