Data Engineer
Technology
Philadelphia, United States$125,000 - $135,000 /year2 months ago
Full timeFully remote
Job description
We are partnering with a global leader in providing innovative IT staffing and solutions across various industries.
The Role
- Develop, test, and maintain ETL and data engineering jobs that bring data into Databricks and support downstream analytics and reporting.
- Work with business and technical stakeholders to translate requirements into scalable, production-ready data pipelines.
- Build and maintain pipelines across AWS, Databricks, and Snowflake environments.
- Enhance existing legacy data engineering jobs as part of broader modernization and migration efforts.
- Create and maintain technical documentation, specifications, test plans, and operational support materials.
- Perform testing and quality assurance to validate data accuracy and pipeline reliability.
- Hands-on experience developing ETL, ELT, or data engineering pipelines in production environments.
- Strong experience with Databricks, Spark-based processing, and modern data pipeline development.
- Experience working with AWS cloud services and Snowflake data platforms.
- Proficiency with infrastructure-as-code practices, preferably Terraform.
- Experience implementing CI/CD practices using Concourse, GitHub Actions, or comparable tools.
- Ability to write clear technical specifications, documentation, and support materials.
- Opportunity to support critical data engineering initiatives.
- Contribute to significant migration activities and modernization efforts.
- Collaborative environment with cross-functional teams.
- Chance to work with cutting-edge data technologies like Databricks, AWS, and Snowflake.
Keywords
Apache SparkCloud computingCI / CDBig dataAWSGithubTerraformCI/CD
Interested in this role?