Lead Data Engineer (Python, SQL)

Requirements

Must have:

- Over 10 years of experience in Data Engineering with Databricks, Snowflake, and Spark - Proficiency in Java or Python programming - 1.5+ years of expertise in data modeling, warehousing, data analysis, and profiling - Ability to identify trends and anomalies in datasets - Familiarity with AWS technologies such as S3, AWS Glue, EMR, and IAM roles/permissions - Experience with one or more query languages (e.g., SQL, PL/SQL, DDL, Spark SQL, Scala) - Work experience with relational databases like Teradata, handling both structured and unstructured data - Bachelors or Masters degree (or equivalent experience) in Data Science, Statistics, Computer Science, or Mathematics - Experience with scripting languages (e.g., Python, KornShell)

Responsibilities:

- Lead data engineering projects and initiatives to enhance data processing capabilities - Collaborate with data scientists and analysts to translate business requirements into technical specifications - Design and implement data models and warehouses for efficient data storage and retrieval - Analyze data to ensure accuracy and identify significant patterns - Develop and maintain ETL processes using AWS tools and technologies - Optimize data pipelines for performance and reliability - Mentor and guide junior data engineers in best practices

Company:

We are seeking a Lead Data Engineer for a 6-month contract-to-permanent position based in Plano, TX. Our team is dedicated to leveraging data to drive business insights and improvements. We offer competitive hourly rates ranging from $75.00 to $80.00. You will have the opportunity to work onsite and participate in both initial Zoom and in-person interviews. We value collaboration and continuous learning within our innovative environment.