Development Engineer II - SQL/Python (Onsite)

The IT Data Engineer II advances by incorporating data architecture principles to design and propose data solutions that may require architecture reviews. They have a solid understanding of data pipeline orchestration, including developing solutions that manage data flow sequences with appropriate monitoring. Their skill set includes developing in modern data platforms and enhancing their knowledge of data warehousing in an analytics environment.

This role also requires working knowledge of agentic AI frameworks and the ability to integrate AI-driven automation into data engineering workflows, with an awareness of AI cost management and data privacy considerations in AI contexts.

Essential Duties and Responsibilities

Design, implement, and optimize data pipelines using SQL and Python, with a strong focus on code quality and reusability.

Develop and maintain ETL/ELT processes using modern transformation frameworks (e.g., dbt) and contribute to data warehousing solutions, including star schema and Kimball or Snowflake methodologies.

Implement data pipeline orchestration using tools such as Airflow, Dagster, or Prefect, managing scheduling, dependencies, and error handling.

Write and optimize SQL and calculations within data visualization tools to enhance data models and performance.

Contribute to the enforcement of data governance policies and support compliance with data security standards.

Build, deploy, and support data visualization solutions that effectively communicate data insights.

Participate in cloud cost optimization efforts within AWS, GCP, or Azure, ensuring efficient use of cloud resources.

Contribute to the development of data architecture and support data streaming initiatives using technologies such as Kafka or Pub/Sub.

Work with containerized environments (Docker) for pipeline development, testing, and deployment.

Implement data quality tests and validation checks using frameworks