Skip to main content

Data Engineer - Databricks

Technology
Supersourcing
1 month ago

Job description

Key Responsibilities :

  • Develop and maintain scalable data pipelines using Databricks and Apache Spark.
  • Build, optimize, and maintain ETL/data processing pipelines for large-scale data workloads.
  • Perform data extraction, transformation, and processing using Python, PySpark, and SQL.
  • Design and implement data models and data warehousing solutions.
  • Develop and optimize Databricks notebooks for data processing, exploration, and analysis.
  • Monitor pipeline performance and troubleshoot data processing and performance issues.
  • Collaborate with data scientists, data analysts, and business stakeholders to deliver data solutions.
  • Support analytics, reporting, and BI initiatives using Power BI.
  • Work with cloud-based data platforms and services across AWS, Azure, or GCP.
  • Ensure data quality, reliability, and performance across data engineering workflows.

Tech Stack :

  • Databricks, Python, PySpark/Apache Spark, SQL, Power BI, AWS/Azure/GCP.

Additional Requirements :

  • Willingness to work remotely with office visits to Pune, Bangalore, or Hyderabad whenever required based on business/project needs.
  • Availability for weekend interview drives may be required based on the hiring schedule.
Keywords
Apache SparkPythonSqlApache LicenseApache Http Server

Interested in this role?