Skip to main content

Data Engineer

Technology
Plano, United States2 months ago
Service contract

Job description

Senior Data Engineer – Identity &

  • Access Management

Location: 100% Remote

Work Hours: Must work within Eastern Time business hours

Organization: Cyber – Identity &

  • Access Management

Position Overview

Client’s Cyber / Identity &

  • Access Management organization is building a new application and engineering capability focused on agentic technology and risk identification.

We are seeking a Senior Data Engineer / Data &

  • Backend Engineer who can help build the application from the ground up. This is not a traditional data engineering position. The ideal candidate will combine strong data engineering, AWS cloud, API development, application performance, and production troubleshooting skills.

The engineer will help build data pipelines and a low-latency GraphQL API that will make data available to Client employees and support critical runtime developer workflows.

This will be a small team consisting of two full-time engineers and this senior contractor, providing an opportunity to have significant technical ownership and influence.

Key Responsibilities

  • Design, build, and optimize high-volume data pipelines supporting the new IAM application.
  • Develop and maintain scalable data engineering solutions using AWS and modern data technologies.
  • Build and support a lightweight, low-latency GraphQL API that exposes data to internal applications and users.
  • Design data models and data-processing workflows to efficiently present data through APIs.
  • Develop and maintain data pipelines using technologies such as PySpark, Apache Spark, AWS Glue, and related data platforms.
  • Work with AWS services including Lambda, ECS, DynamoDB, PostgreSQL, S3, and AWS Glue.
  • Troubleshoot application performance, latency, scalability, and reliability issues in production.
  • Implement monitoring and observability solutions for data pipelines and APIs.
  • Optimize cloud infrastructure and applications for performance, scalability, and reliability.
  • Collaborate with engineering, cybersecurity, IAM, and other stakeholders to define technical solutions.
  • Participate in architecture, design, development, testing, deployment, and production support.
  • Help establish engineering practices and technical standards for the newly formed team.
  • Translate complex data into reliable, accessible APIs and services.
  • Support the development of systems designed to identify and assess risks associated with emerging agentic technologies.

Required Qualifications

  • Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
  • 7+ years of IT/technology experience.
  • 5+ years of hands-on software/data engineering experience.
  • Strong hands-on AWS experience.
  • Strong data engineering experience with large-scale data pipelines.
  • Experience with PySpark, Apache Spark, AWS Glue, or similar technologies.
  • Strong API development experience.
  • Experience developing GraphQL or REST APIs.
  • Experience building and troubleshooting low-latency applications/APIs.
  • Strong experience with production monitoring and troubleshooting.
  • Experience with cloud-based databases and data stores.
  • Strong programming experience with Python, Scala languages.
  • Strong analytical, troubleshooting, and problem-solving skills.

Required AWS Experience

Candidates should have hands-on experience with several of the following, with the following considered particularly important:

  • AWS Lambda
  • Amazon ECS
  • DynamoDB
  • PostgreSQL
  • Amazon S3
  • AWS Glue
Experience with additional AWS services and serverless technologies is a plus.

Data Engineering Skills

Experience with one or more of the following:

  • PySpark
  • Apache Spark
  • AWS Glue
  • Data pipelines
  • Batch processing
  • Distributed data processing
  • Data modeling
  • Data integration
  • Data quality
  • Large-scale data processing
  • Performance optimization

API &

  • Application Development

  • GraphQL API development
  • REST API development
  • Low-latency API design
  • API performance optimization
  • API integration
  • Application troubleshooting
  • Distributed application architecture
  • Monitoring and observability

Preferred Qualifications

  • Experience building applications from the ground up.
  • Experience working in cybersecurity or Identity &

    • Access Management.

  • Experience with agentic AI or AI-enabled applications.
  • Experience supporting critical runtime applications.
  • Experience with cloud performance and latency optimization.
  • Experience with production monitoring and observability.
  • Experience with serverless AWS architectures.
  • Experience with Snowflake, Batch, or similar data platforms.
  • Experience working in a small, highly collaborative engineering team.
  • Client experience is highly desirable.

Work Environment

  • 100% remote opportunity.
  • Candidate must be able to work during Eastern Time Zone business hours.
  • This is a new application and team build-out within Client's Cyber / Identity &

    • Access Management organization.

  • The candidate will work closely with two full-time engineers and will be expected to provide senior-level technical guidance and help accelerate the team's development.

Interested in this role?