Job Description: As a Senior Python Developer, you will be responsible for designing, developing, and deploying scalable applications. Your expertise in Python-based frameworks, backend development, APIs, and cloud technologies will be crucial in ensuring the success of data pipelines and ETL processes.
Your role will involve collaborating with cross-functional teams to deliver high-quality data solutions in an Agile environment. Additionally, you will be involved in setting up and maintaining CI/CD pipelines for data workflows and deployments, as well as monitoring and optimizing data processes for performance and cost efficiency.
Key Responsibilities
- Design, develop, and optimize scalable data pipelines and ETL processes using Azure Data Services and Databricks.
- Implement data transformations and analytics using PySpark and Python.
- Configure and manage Databricks Unity Catalog for secure data governance and access control.
- Orchestrate workflows using Apache Airflow for scheduling and automation.
- Collaborate with cross-functional teams to deliver high-quality data solutions in an Agile environment.
- Set up and maintain CI/CD pipelines for data workflows and deployments.
- Manage version control and branching strategies using Git.
- Write and execute unit tests to ensure code quality and reliability.
- Monitor, troubleshoot, and optimize data processes for performance and cost efficiency.
Qualification Required
- Strong experience with Azure Data Factory, Azure Data Lake, Azure Synapse, or related services.
- Proficiency in Python and PySpark for data engineering tasks.
- Hands-on experience in building and managing workflows in Databricks, including Unity Catalog.
- Experience with Apache Airflow for workflow scheduling and automation.
- Familiarity with tools like Azure DevOps or Jenkins for automated deployments.
- Expertise in Git for code management.
- Strong understanding of unit testing frameworks for data pipelines.
- Experience working in Agile teams and using tools like Jira or Azure Boards.
- Minimum 5 years of relevant experience in Python development.
Additional Company Details: The company is looking for a Senior Python Developer with mandatory skills in Python, Databricks, and Git. Desired skills include deep expertise in Python, experience with Databricks, PySpark, Git, and the Azure cloud platform.
Job Description: As a Senior Python Developer, you will be responsible for designing, developing, and deploying scalable applications. Your expertise in Python-based frameworks, backend development, APIs, and cloud technologies will be crucial in ensuring the success of data pipelines and ETL processes.
Your role will involve collaborating with cross-functional teams to deliver high-quality data solutions in an Agile environment. Additionally, you will be involved in setting up and maintaining CI/CD pipelines for data workflows and deployments, as well as monitoring and optimizing data processes for performance and cost efficiency.
Key Responsibilities
- Design, develop, and optimize scalable data pipelines and ETL processes using Azure Data Services and Databricks.
- Implement data transformations and analytics using PySpark and Python.
- Configure and manage Databricks Unity Catalog for secure data governance and access control.
- Orchestrate workflows using Apache Airflow for scheduling and automation.
- Collaborate with cross-functional teams to deliver high-quality data solutions in an Agile environment.
- Set up and maintain CI/CD pipelines for data workflows and deployments.
- Manage version control and branching strategies using Git.
- Write and execute unit tests to ensure code quality and reliability.
- Monitor, troubleshoot, and optimize data processes for performance and cost efficiency.
Qualification Required
- Strong experience with Azure Data Factory, Azure Data Lake, Azure Synapse, or related services.
- Proficiency in Python and PySpark for data engineering tasks.
- Hands-on experience in building and managing workflows in Databricks, including Unity Catalog.
- Experience with Apache Airflow for workflow scheduling and automation.
- Familiarity with tools like Azure DevOps or Jenkins for automated deployments.
- Expertise in Git for code management.
- Strong understanding of unit testing frameworks for data pipelines.
- Experience working in Agile teams and using tools like Jira or Azure Boards.
- Minimum 5 years of relevant experience in Python development.
Additional Company Details: The company is looking for a Senior Python Developer with mandatory skills in Python, Databricks, and Git. Desired skills include deep expertise in Python, experience with Databricks, PySpark, Git, and the Azure cloud platform.
AceNet