Senior Python Developer & Data Engineer | Krakow
DCV TechnologiesOpis stanowiska
Senior Python Developer & Data Engineer
Location: Kraków, Poland
Work Model: Hybrid – 3 days per week in the office
Experience: 10 years
About the Role
We are looking for an experienced Senior Python Developer & Data Engineer with strong expertise in Python development, data engineering, and large-scale ETL processes. The ideal candidate will have hands-on experience with PySpark, Databricks, Oracle databases, and Unix/Linux environments, along with a software engineering background in Java or C#.
You will be responsible for designing, developing, optimizing, and maintaining robust data processing solutions and ETL pipelines, ensuring high performance, scalability, reliability, and data quality.
Key Responsibilities
- Design, develop, and maintain scalable data processing applications using Python and PySpark.
- Build, enhance, and optimize ETL/ELT pipelines for large-scale data integration and transformation.
- Develop and maintain data engineering solutions using Databricks.
- Work with Oracle databases, including complex SQL queries, data extraction, and performance optimization.
- Develop and maintain Unix/Linux shell scripts to support data processing and automation.
- Schedule, monitor, and troubleshoot batch jobs and workflows using AutoSys.
- Analyze complex technical requirements and translate them into efficient, maintainable solutions.
- Optimize application and pipeline performance, ensuring data accuracy, consistency, and reliability.
- Troubleshoot production issues, perform root cause analysis, and implement permanent fixes.
- Collaborate with data engineers, developers, architects, business analysts, and other stakeholders.
- Participate in code reviews, technical design discussions, testing, and documentation.
- Follow software development best practices, coding standards, and established delivery processes.
- 10 years of overall experience in software development, data engineering, or a related technical role.
- Strong hands-on experience in Python development.
- Solid experience with PySpark and distributed data processing.
- Proven experience developing and maintaining ETL pipelines and data integration solutions.
- Practical experience with Databricks and large-scale data processing.
- Strong knowledge of Oracle databases and SQL.
- Experience working in Unix/Linux environments, including shell scripting.
- Hands-on experience with AutoSys job scheduling and workflow monitoring.
- Previous software development experience in Java or C#, with a solid understanding of object-oriented programming and software engineering principles.
- Strong analytical, problem-solving, and debugging skills.
- Experience working in Agile teams and collaborating with cross-functional stakeholders.
- Excellent communication skills and the ability to work independently in a senior engineering role.
- Experience optimizing Spark jobs and processing large volumes of data.
- Knowledge of data modelling, data warehousing, and data quality practices.
- Experience with production support, incident management, and performance tuning.
- Familiarity with CI/CD, Git, automated testing, and code review practices.
- Experience working on enterprise-scale data platforms.
- Location: Kraków, Poland
- Hybrid working model: 3 days per week from the Kraków office
- Experience level: Senior – 10 years
We are seeking a senior-level engineer who combines strong Python development skills with practical data engineering expertise. The ideal candidate should be comfortable working across data pipelines, distributed processing, databases, scheduling tools, and enterprise software systems, with a background in Java or C# development.
Interesuje Cię ta oferta?