Lead Data Engineer

We are working with a pioneering tech company that empowers businesses with cutting-edge data solutions, driving innovation and efficiency across industries.

The Role

• Design and implement advanced data architectures, including cloud data lakes and multi-layer designs (Bronze, Silver, Gold).
• Develop complex operational pipelines, ensuring robust data transformation, cleanup, and standardization.
• Establish and enforce production SDLC best practices, including rigorous code reviews, comprehensive testing, and resilient error handling.
• Implement enterprise-level data governance and security measures, such as role-based access controls (RBAC) and data compliance frameworks.
• Deploy, manage, and scale containerized data workloads using AWS ECS and ECR.
• Optimise Snowflake account administration, virtual warehouse strategies, and budget utilization.

What You'll Need

• 10+ years of experience in data engineering, with a focus on data architecture and enterprise modeling.
• Expert-level proficiency in AWS services, including S3, IAM, Lambda, EC2, CloudWatch, and CloudTrail.
• Extensive hands-on experience with Snowflake, including Data Sharing, Time Travel, and Zero-copy cloning.
• Advanced Python development skills for complex data manipulation, automation, and API communication.
• Strong understanding of production SDLC, workflow best practices, and data governance principles.
• Excellent communication skills for interacting with clients and internal teams.

What's On Offer

• Opportunity to lead impactful data initiatives for diverse clients.
• Work within a fully remote, flexible environment.
• Engage with cutting-edge cloud and data technologies.
• Contribute to a culture of technical excellence and innovation.

Apply via Haystack today!