Data Engineer Software Developer

We are working with a global technology and defense leader dedicated to solving the world's toughest challenges in national security, health, and engineering. This organization leverages cutting-edge technology and a vast talent pool to deliver innovative solutions for critical missions worldwide.

The Role

• Design, build, and maintain scalable, reliable data systems and pipelines for ingesting, processing, and transforming complex data sources.
• Integrate and unify data from multiple network operations systems into a consistent, accessible platform, ensuring data quality, accuracy, and security.
• Implement solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), creating pipelines and supporting visualizations.
• Develop and manage data warehouses and data lakes, optimizing infrastructure for performance, scalability, and cost-effectiveness through automation.
• Automate data-related tasks such as ETL/ELT processes, data validation, cleansing, and monitoring, and support CI/CD pipelines.
• Collaborate with data analysts, visualization engineers, and stakeholders to deliver integrated, actionable data solutions, and document architecture and procedures.

What You'll Need

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline with 4+ years of relevant experience.
• Hands-on experience designing, building, and maintaining data pipelines (ETL/ELT) and integrating multiple disparate data sources.
• Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake) and proficiency with Python, Java, SQL, and shell scripting.
• Expertise with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing.
• Familiarity with network operations data and related data models, along with Linux/UNIX system administration and automation.
• Ability to obtain interim Secret DoD Security clearance and Security+ certification within 14 days of start date.

What's On Offer

• Opportunity to work on mission-critical national security projects with advanced technologies.
• Collaborative and fast-paced Agile development environment.
• Support for continuous learning and professional certifications.
• Contribution to solutions that provide a holistic, single-pane-of-glass interface for integrated systems.

Apply via Haystack today!