Data Engineering - AWS/Spark/Python

Job Description

This is a senior-level engineering role where the candidate would be a part of the Data Engineering team distributed in the US and India. They are expected to provide technical leadership, be fully hands-on, and lead by example. They are expected to architect complete end-to-end solutions/data pipelines; data ingestion, ETL, reporting, and APIs.

You Will

• Work with various Big Data technologies on AWS.
• Deploy data pipelines in production based on CI/CD practices using Docker and Airflow
• Contribute to software implementation specs, test plans, participate actively in code reviews and adhere to very high-quality coding practices with good test coverage.
• Mentor and lead other data engineers.

You have

• B.Tech./B.E./M.Tech./MCA or equivalent, in computer science or relevant area
• 6+ years of computer systems design/software architecture experience
• 6+ years of Java/Scala and/or Python programming with good CS fundamentals
• 6+ years of Big Data development experience with Hadoop/Spark and writing ETLs
• 6+ years' experience of SQL, RDBMS and/or NoSQL database technologies
• AWS experience preferred or any other public cloud
• A big plus and way to standout - Experience building Machine Learning pipelines, MLOps, knowledge of fundamental ML/statistical models