Python Developer (Data) and Databricks
Technology
Phaa softwaresolutions
Toronto, Canada1 month ago
Service contractHybrid
Job description
Job Overview
We are seeking a skilled and motivated Senior Python Developer & Data Bricks with strong data-processing experience to join our technology team. This is a six-month contract opportunity with the potential for extension, following a hybrid work arrangement of three days per week onsite in Downtown Toronto.The successful candidate will design, develop, and maintain scalable data-processing solutions using Python, Pandas, and PySpark. You will collaborate with cross-functional teams to transform, integrate, and process large datasets while ensuring performance, reliability, and data quality.
Responsibilities
- Design, develop, and maintain scalable data-processing applications and pipelines using Python.
- Use Pandas and PySpark to clean, transform, validate, and analyze structured and semi-structured datasets.
- Develop reusable and efficient data-processing components capable of handling large volumes of data.
- Integrate data from multiple sources and formats.
- Optimize Python and PySpark code for performance, scalability, and reliability.
- Implement data validation, error handling, logging, and monitoring.
- Write clean, efficient, testable, and maintainable code.
- Perform unit testing, debugging, code reviews, and performance troubleshooting.
- Collaborate with data engineers, analysts, architects, and other cross-functional stakeholders.
- Participate in Agile development activities, including sprint planning, estimation, and retrospectives.
- Maintain clear documentation for data flows, technical designs, code, and deployment processes.
- Strong hands-on experience developing data solutions using Python.
- Strong practical experience with Pandas for data manipulation, transformation, and analysis.
- Strong practical experience with PySpark for distributed data processing.
- Experience with Databricks environments.
- Good understanding of data structures, object-oriented programming, and Python development best practices.
- Experience building and maintaining ETL/ELT pipelines or other large-scale data-processing solutions.
- Experience working with structured and semi-structured data formats such as CSV, JSON, and Parquet.
- Understanding of data quality, validation, performance optimization, and exception handling.
- Familiarity with the software development life cycle, Agile methodologies, and test-driven development.
- Strong analytical, troubleshooting, communication, and collaboration skills.
- Familiarity with cloud-based data platforms such as Azure, AWS, or Google Cloud.
- Experience with data lake or lakehouse architectures.
- Knowledge of workflow orchestration and scheduling tools.
Ability to commute/relocate
- Toronto, ON: reliably commute or plan to relocate before starting work (required)
- Data Bricks: 3 years (preferred)
- Python: 7 years (required)
Keywords
pythonazure-databricksdatabricksplanning-and-designvisual-art-designproduct-development-and-designpandaspysparkdata-qualitydata-integrationscalabilitydata-validationerrors-omissions-e-oerror-handlingtesting-and-analysisdebuggingcode-reviewtroubleshootingtraining-and-developmentagile-software-development
Interested in this role?