Data Engineer - SQL, Python, Linux
Job description
Title : Big Data Engineer Location : DC Metro Area Target Start Date : ASAP Type : contract We are seeking an experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. This is an engineering-focused role supporting data-intensive applications and data science workflows. The ideal candidate has strong experience with distributed systems, cloud platforms, and technologies such as Spark, Hadoop, Python, and Scala.
Design, develop, and maintain scalable data processing pipelines using Spark, Hadoop, Python, Scala, and related technologies. Build reliable solutions for data ingestion, storage, transformation, and processing. Translate business and analytical requirements into scalable engineering solutions.
Optimize data pipelines for performance, scalability, and reliability. Build datasets, features, and pipelines that support data science, analytics, and model development. Develop automated testing frameworks and implement unit, integration, system, and end-to-end testing.
Implement data quality controls and continuous testing practices. Monitor and troubleshoot production data pipelines and resolve performance or reliability issues. Collaborate with data scientists, analysts, and engineering teams on data-driven solutions.
Evaluate emerging technologies and continuously improve data architecture and engineering practices. Strong hands-on Big Data engineering experience. Strong programming skills in Python and/or Scala.
Experience designing and optimizing large-scale data pipelines and distributed processing systems.
Experience with cloud-based data platforms and services. Strong understanding of data ingestion, transformation, storage, and processing patterns.
Experience with automated testing and data quality practices.
Experience supporting data science or machine learning workflows.
Experience with graph data or graph technologies is a plus.
Ideal Background
This role is best suited for a hands-on data engineer who has built large-scale data platforms and pipelines while working closely with data science teams. Direct data science experience is not required, but experience building the data infrastructure that supports analytics and machine learning is highly valued. Our expertise spans across project services, contract-to-hire, direct search, and managed services onshore, nearshore, and hybrid.
For over 25 years, we have connected thousands of consultants with meaningful roles through a personal, communication-driven approach, partnering with a diverse client base to build high-performing teams and create lasting impact. We champion equality and inclusivity, proudly supporting an Equal Opportunity Employer policy. We welcome applicants regardless of Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other status protected by law.
Interested in this role?