Senior Data Engineer - Python/SQL/ETL

Role : Senior Data Engineer (AWS, Python/Java) / Immediate joiners only

Location : Bengaluru

Work Mode : Onsite 5 days

Compensation : 25 LPA to 42 LPA

Roles &

Responsibilities :

This role offers an exciting opportunity to work on diverse projects, collaborating with cross functional teams to design, build, and optimize data pipelines and infrastructure.

Responsibilities :

• Design, develop, and maintain scalable data pipelines and ETL processes leveraging AWS services such as S3, Glue, EMR, Lambda, and Redshift.
• Collaborate with data scientists and analysts to understand data requirements and implement solutions that support analytics and machine learning initiatives.
• Optimize data storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness.
• Implement data governance and security best practices to ensure compliance and data integrity.
• Troubleshoot and debug data pipeline issues, providing timely resolution and proactive monitoring.
• Stay abreast of emerging technologies and industry trends, recommending innovative solutions to enhance data engineering capabilities.

Ideal Candidate :

• Strong Data Engineer (AWS) Profile
• Mandatory : Minimum 6 years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.
• Mandatory : 3 years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.
• Mandatory : Strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.
• Mandatory : Strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.
• Mandatory : Hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.
• Mandatory : Experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.
• Mandatory : B.Tech / B.E./ M.Tech
• Mandatory : Immediate joiners or candidates who can join within 2 weeks.
• Preferred : Experience with Apache Airflow, Docker, and Kubernetes for pipeline orchestration and containerized data engineering workloads.

Interview Process :

• R1
• R2
• R3
• HR Discussion