Job description
Core Technical Skills
Databricks Skill Level - Expert
- Solid experience in PySpark for data ingestion, transformation, and cleansing.
- Expertise in Delta Lake, job scheduling, and optimizing Spark jobs.
- Implement New Enhancements and new plant onboarding.
- Experience integrating Databricks with ADF pipelines and Azure Data Lake.
- Knowledge of data validation, logging, and exception handling frameworks.
- ADF – Expert Level:
- End-to-end pipeline development, data movement, and orchestration experience.
- ADLS – Expert Level:
- Deep knowledge of file structures, partitioning strategies, and access control.
Interested in this role?