Databricks Engineer
Job description
One of our clients which is having operations globally is looking a Databricks Engineer- Hybrid work to Minneapolis.MN. Please find the below job description and request you to share me your resume to srinath.k@programmers.ai
Role: Databricks Engineer
Location: Minneapolis, MN - Hybrid work
Duration: Fulltime with all the benefits
Experience: 8+years and fulltime only
Job Summary The Azure Databricks Engineer will design, build, and optimize scalable Lakehouse solutions on Azure using Databricks, Delta Lake, PySpark, ADLS Gen2, ADF, and Synapse.
Key Responsibilities
- Design and implement Databricks Lakehouse architectures using Delta Lake and Medallion (Bronze/Silver/Gold) frameworks.
- Develop data pipelines using Databricks Workflows, Delta Live Tables, Auto Loader, ADF, and Databricks SQL.
- Build and manage enterprise data solutions with PySpark, Spark SQL, ADLS Gen2, and Synapse.
- Optimize Spark performance through partitioning, cluster tuning, data skew management, and Photon acceleration.
- Lead data migration projects from legacy platforms such as SAS, Hadoop, Teradata, Oracle, SQL Server, and ETL tools.
- Ensure data governance, security, lineage, access controls, and support both batch and real-time data processing.
Required Skills Azure Databricks, Delta Lake, PySpark, Spark SQL, ADLS Gen2, Azure Data Factory, Synapse Analytics, Data Modeling, Data Migration, Performance Tuning, Streaming, Data Governance, and Security.
Provide your feedback on BizChat
Interested in this role?