Dataengineer (AWS + Airflow+Python+Pyspark)

Required Skills

• Advanced proficiency in Python, including libraries such as Pandas, PySpark, and boto3
• Experience designing workflows in Apache Airflow (MWAA)
• Hands-on experience with Amazon Redshift for analytics and data warehousing
• Solid SQL skills and experience with data modeling and transformation
• Comfortable with Amazon S3, including setting up data lake architecture
• Familiar with AWS core services: EC2, S3, IAM, Lambda
• Experience using AWS Secrets Manager and AWS KMS for secure data access
• Strong understanding of batch processing (AWS Glue, EMR) and streaming (Kinesis)
• Version control using Git