Python Pyspark Developer
Technology
Unison Group1 month ago
Service contractOn-site
Job description
Job Description:
- Strong hands-on experience in Python and PySpark development for large-scale data processing
- Design, develop and maintain ETL/data pipelines using PySpark, Python and SQL
- Experience working with Big Data technologies, data transformation and batch processing
- Strong knowledge of SQL, data modelling, performance tuning and optimization
- Experience with cloud/data platforms such as AWS, Azure, Databricks or equivalent is preferred
- Good understanding of data quality, reconciliation, validation and error handling
- Ability to analyse business requirements and translate them into scalable technical solutions
- Experience working in Agile/Scrum environments with strong communication and stakeholder-management skills
- Candidates should be available to work in a Singapore-based banking environment
Keywords
pythonpysparkjob-descriptionstraining-and-developmentdata-processingplanning-and-designvisual-art-designproduct-development-and-designextract-transform-and-load-etldata-pipelinesqlbig-datadata-transformationbatch-processing-batch-servicesdata-modelvehicle-modification-tuningcloud-datadata-platformamazon-web-servicesmicrosoft-azure
Interested in this role?