Role Overview :
We are seeking a seasoned Data Engineer to architect and scale our data infrastructure, ensuring that our analytical capabilities remain at the cutting edge of the industry. In this role, you will be responsible for designing robust data pipelines, managing complex ETL processes, and ensuring the seamless flow of information across our enterprise systems. You will collaborate closely with cross-functional teams, including data scientists, product managers, and business stakeholders, to translate complex requirements into scalable technical solutions.
Your work will directly influence business outcomes by providing high-quality, reliable data that powers strategic decision-making and enhances the overall customer experience across our digital platforms.
Key Responsibilities :
- Architect and maintain high-performance data pipelines to ensure the timely delivery of clean, structured data for downstream analytics and reporting.
- Design and implement sophisticated data models that support evolving business needs while ensuring optimal performance and scalability of our data warehousing solutions.
- Develop and optimize complex SQL queries and Python-based transformation scripts to streamline data processing and improve system efficiency.
- Integrate diverse data sources through robust API development and management to create a unified view of our business operations.
- Partner with internal stakeholders to identify data gaps and implement automated solutions that reduce manual intervention and enhance data integrity.
- Mentor junior team members and contribute to technical documentation to foster a culture of engineering excellence and knowledge sharing across the organization.
Required Skillset :
- Demonstrated expertise in Python, specifically leveraging Pandas and NumPy to manipulate large datasets and perform complex data transformations.
- Proven ability to design and manage end-to-end ETL processes and data warehousing architectures that support high-volume data environments.
- Advanced proficiency in SQL for complex data modeling, query optimization, and database management.
- Extensive experience in building and maintaining API integrations to facilitate seamless data exchange between disparate systems.
- Strong analytical and problem-solving skills, with the ability to communicate complex technical concepts to non-technical stakeholders effectively.
- A collaborative mindset with the ability to thrive in a distributed, remote-first environment, maintaining high levels of productivity and communication across multiple time zones.
- A Bachelors or Masters degree in Computer Science, Engineering, or a related quantitative field, backed by 6 to 11 years of hands-on experience in data engineering roles.