Data Engineer – AWS Data Platform
Technology
أبو ظبي, الإمارات العربية المتحدةمنذ 2 أسابيع
عقد خدمات
وصف الوظيفة
Years of Experience
Minimum 5 yrs
Required Skills
- Strong hands-on experience delivering enterprise-scale data engineering solutions on AWS.
- Strong development experience with:
- Python / PySpark
- SQL
- AWS Glue
- AWS S3
- Strong experience designing and developing ETL/ELT and data ingestion pipelines.
- Experience working with:
- AWS Glue and Glue Catalog
- Amazon Redshift
- Amazon Athena
- AWS Lake Formation
- Apache Iceberg or similar open table formats
- Good understanding of:
- Data lake / lakehouse architecture
- Data warehousing
- Dimensional and analytical data modelling
- Data partitioning and optimisation
- Metadata management and data lineage
- Strong understanding of data quality, reconciliation and validation techniques.
- Experience integrating data from multiple source technologies, such as:
- Relational databases
- APIs
- Files / object storage
- Streaming/event-based sources
- Experience troubleshooting complex data and pipeline issues.
- Good understanding of IAM, security and data-access controls within AWS.
- Experience with version control and CI/CD using tools such as:
- GitHub
- Jenkins
- GitHub Actions
- AWS CodePipeline
- Experience working within Agile delivery environments using JIRA and Confluence.
- Strong professional experience in Data Engineering and Enterprise Data Platforms.
- Demonstrable experience delivering production-grade data pipelines in complex enterprise environments.
- Experience working within Banking or Financial Services strongly preferred.
- Understanding of data governance, security and regulatory requirements within a controlled enterprise environment.
- Experience working across the full engineering lifecycle from requirements and source-data analysis through development, testing, deployment and production support.
Keywords
RedshiftJiraMetadataPartitionPythonSqlApache Http ServerCI/CD
هل أنت مهتم بهذه الوظيفة؟