Skip to main content

Databricks Engineer

Technology
New York, United States2 months ago
Service contract

Job description

Core Technical Skills

Databricks Skill Level - Expert

  • Solid experience in PySpark for data ingestion, transformation, and cleansing.
  • Expertise in Delta Lake, job scheduling, and optimizing Spark jobs.
  • Implement New Enhancements and new plant onboarding.
  • Experience integrating Databricks with ADF pipelines and Azure Data Lake.
  • Knowledge of data validation, logging, and exception handling frameworks.
  • ADF – Expert Level:
  • End-to-end pipeline development, data movement, and orchestration experience.
  • ADLS – Expert Level:
  • Deep knowledge of file structures, partitioning strategies, and access control.

Interested in this role?