Skip to main content

Python Pyspark Developer

Technology
Unison Group
1 month ago
Service contractOn-site

Job description

Job Description:

  • Strong hands-on experience in Python and PySpark development for large-scale data processing
  • Design, develop and maintain ETL/data pipelines using PySpark, Python and SQL
  • Experience working with Big Data technologies, data transformation and batch processing
  • Strong knowledge of SQL, data modelling, performance tuning and optimization
  • Experience with cloud/data platforms such as AWS, Azure, Databricks or equivalent is preferred
  • Good understanding of data quality, reconciliation, validation and error handling
  • Ability to analyse business requirements and translate them into scalable technical solutions
  • Experience working in Agile/Scrum environments with strong communication and stakeholder-management skills
  • Candidates should be available to work in a Singapore-based banking environment

Keywords
pythonpysparkjob-descriptionstraining-and-developmentdata-processingplanning-and-designvisual-art-designproduct-development-and-designextract-transform-and-load-etldata-pipelinesqlbig-datadata-transformationbatch-processing-batch-servicesdata-modelvehicle-modification-tuningcloud-datadata-platformamazon-web-servicesmicrosoft-azure

Interested in this role?