Skip to main content

Data Engineer

Technology
Haystack
Philadelphia, United States$125,000 - $135,000 /year2 months ago
Full timeFully remote

Job description

We are partnering with a global leader in providing innovative IT staffing and solutions across various industries.

The Role

  • Develop, test, and maintain ETL and data engineering jobs that bring data into Databricks and support downstream analytics and reporting.
  • Work with business and technical stakeholders to translate requirements into scalable, production-ready data pipelines.
  • Build and maintain pipelines across AWS, Databricks, and Snowflake environments.
  • Enhance existing legacy data engineering jobs as part of broader modernization and migration efforts.
  • Create and maintain technical documentation, specifications, test plans, and operational support materials.
  • Perform testing and quality assurance to validate data accuracy and pipeline reliability.

What You'll Need

  • Hands-on experience developing ETL, ELT, or data engineering pipelines in production environments.
  • Strong experience with Databricks, Spark-based processing, and modern data pipeline development.
  • Experience working with AWS cloud services and Snowflake data platforms.
  • Proficiency with infrastructure-as-code practices, preferably Terraform.
  • Experience implementing CI/CD practices using Concourse, GitHub Actions, or comparable tools.
  • Ability to write clear technical specifications, documentation, and support materials.

What's On Offer

  • Opportunity to support critical data engineering initiatives.
  • Contribute to significant migration activities and modernization efforts.
  • Collaborative environment with cross-functional teams.
  • Chance to work with cutting-edge data technologies like Databricks, AWS, and Snowflake.

Apply via Haystack today!

Keywords
Apache SparkCloud computingCI / CDBig dataAWSGithubTerraformCI/CD

Interested in this role?