Database Engineer (SQL, NoSQL)

Requirements

Must have:

- Over 5 years of experience in data engineering or data development - Extensive practical experience with Google Cloud Platform (GCP) - Proficiency in BigQuery (essential requirement) - Skilled in Dataflow / Apache Beam - Experience with Dataform and Cloud Run Services - Familiarity with Cloud Storage and Pub/Sub for streaming data pipelines - Advanced proficiency in SQL - Competency in Python or Java for developing data pipelines - Strong grasp of data modeling techniques (star and snowflake schemas) - Experience in designing and optimizing ETL/ELT processes - Knowledge of workflow orchestration tools such as Cloud Composer or Airflow - Basic understanding of CI/CD methodologies and version control using Git

Responsibilities:

- Design, produce, and uphold scalable data pipelines on GCP - Build and enhance ETL/ELT workflows utilizing tools like Dataflow, Dataproc, and Cloud Composer - Create and manage datasets, tables, and transformations in BigQuery - Ensure the quality, integrity, and consistency of data across all pipelines - Optimize query performance and manage cost efficiency in BigQuery environments - Support data intake from various sources, including APIs, databases, flat files, and streaming data - Work collaboratively with analytics and business teams to provide reporting and data solutions - Monitor and resolve pipeline failures and performance challenges - Implement best practices concerning data governance, security, and compliance - Aid in ongoing data engineering operations and enhancements

Company:

We are a dynamic company focused on leveraging data to drive business results. Our team is dedicated to innovation and excellence in data engineering, and we pride ourselves on fostering a collaborative environment. Located in [Insert Location], we offer competitive benefits, including flexible work arrangements and opportunities for professional growth.