Skip to main content

Lead Data Engineer (Snowflake)

Technology
1 week ago
Service contract

Job description

We're looking for a hands-on, collaborative Data Engineer familiar with modern tools to build and maintain modern pipelines. In this role you'll have the opportunity to form the beginning of a data engineering team that will focus on executing a migration from a large legacy data warehouse to Snowflake for our FoodBuy sector. This is a multi-year project that will eventually transition to support of the finalized data warehouse.

The initial technologies you will need to know, and support include Snowflake, Snowpipes, Apache Airflow, FiveTran, and AWS Database Migration Service.

Job Responsibilities

· Define, build, test, and implement scalable data pipelines

· Assist the team on migrating multiple sources into Snowflake

· Monitor pipeline performance and cost efficiency

· Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues

· Collaborate with BI Engineers to ensure the raw data is accurate and available, allowing them to transform the data

Job Qualifications

· 4+ years in an ETL or Data Engineering role; building and implementing data pipelines

· Experience managing Snowflake instances, including data ingestion and modeling

· Leverage Python to create maintainable, reusable, and complex functions

· Very strong skills with SQL with the ability to write efficient queries

· Familiarity with AWS data services such as S3, DMS, Redshift, Lambda, Glue, SQS, SNS, and API Gateway

· Highly self-motivated and directed with an attention to detail

· Hold persuasive and professional communication skills (presentations, documentation, and emails)

Required Skills : 4+ years in an ETL or Data Engineering role; building and implementing data pipelines · Experience managing Snowflake instances, including data ingestion and modeling · Leverage Python to create maintainable, reusable, and complex functions · Very strong skills with SQL with the ability to write efficient queries

· Familiarity with AWS data services such as S3, DMS, Redshift, Lambda, Glue, SQS, SNS, and API Gateway · Highly self-motivated and directed with an attention to detail · Hold persuasive and professional communication skills (presentations, documentation, and emails)

Basic Qualification :

Additional Skills :

Background Check :Yes

Drug Screen :Yes

Notes

Selling points for candidate :

Project Verification Info

Candidate must be your W2 Employee :Yes

Exclusive to Apex :Yes

Face to face interview required :No

Candidate must be local :No

Candidate must be authorized to work without sponsorship :Yes

Interview times set :Yes

Type of project :Development/Engineering

Master Job Title :Big Data: Dev

Branch Code :Charlotte

Interested in this role?