Iris Software - Senior Data Engineer - Python/PySpark

Job Description :

We are looking for an experienced Senior Data Engineer to design, build, and maintain scalable ELT/ETL pipelines and cloud-based data platforms in a Data Lake/Data Warehouse environment.

Key Responsibilities :

• Design and develop resilient ELT/ETL data pipelines on cloud platforms
• Build and optimize data processing using Python, SQL, PySpark
• Ensure data quality, governance, and reliability across pipelines
• Deploy and manage solutions using AWS services (S3, Glue, EMR, Athena, Lambda, SNS, SQS, EC2, VPC)
• Implement CI/CD pipelines and follow DevOps best practices
• Collaborate with stakeholders and mentor junior engineers

Required Skills :

• Expert hands-on experience with Python, SQL, PySpark
• Solid understanding of Data Lakes and Data Warehouses
• Hands-on experience with AWS data & compute services
• Experience with Data Governance, Data Quality frameworks
• Proficiency in Jenkins, CI/CD, Git-based source control