Job description
We're looking for a hands-on, collaborative Data Engineer familiar with modern tools to build and maintain modern pipelines. In this role you'll have the opportunity to form the beginning of a data engineering team that will focus on executing a migration from a large legacy data warehouse to Snowflake for our FoodBuy sector. This is a multi-year project that will eventually transition to support of the finalized data warehouse.
The initial technologies you will need to know, and support include Snowflake, Snowpipes, Apache Airflow, FiveTran, and AWS Database Migration Service.
Job Responsibilities
· Define, build, test, and implement scalable data pipelines· Assist the team on migrating multiple sources into Snowflake
· Monitor pipeline performance and cost efficiency
· Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues
· Collaborate with BI Engineers to ensure the raw data is accurate and available, allowing them to transform the data
Job Qualifications
· 4+ years in an ETL or Data Engineering role; building and implementing data pipelines· Experience managing Snowflake instances, including data ingestion and modeling
· Leverage Python to create maintainable, reusable, and complex functions
· Very strong skills with SQL with the ability to write efficient queries
· Familiarity with AWS data services such as S3, DMS, Redshift, Lambda, Glue, SQS, SNS, and API Gateway
· Highly self-motivated and directed with an attention to detail
· Hold persuasive and professional communication skills (presentations, documentation, and emails)
Required Skills : 4+ years in an ETL or Data Engineering role; building and implementing data pipelines · Experience managing Snowflake instances, including data ingestion and modeling · Leverage Python to create maintainable, reusable, and complex functions · Very strong skills with SQL with the ability to write efficient queries
· Familiarity with AWS data services such as S3, DMS, Redshift, Lambda, Glue, SQS, SNS, and API Gateway · Highly self-motivated and directed with an attention to detail · Hold persuasive and professional communication skills (presentations, documentation, and emails)
Basic Qualification :
Additional Skills :
Background Check :Yes
Drug Screen :Yes
Notes
Selling points for candidate :
Project Verification Info
Candidate must be your W2 Employee :Yes
Exclusive to Apex :Yes
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship :Yes
Interview times set :Yes
Type of project :Development/Engineering
Master Job Title :Big Data: Dev
Branch Code :Charlotte
Interested in this role?
