Python Developer - Databricks and Azure

Summary

Job Summary (Python Developer Databricks and Azure)

• Minimum 7 10 years of experience in Python, ETL data handling, and SQL.
• Design and implement scalable data and application solutions using Python and Azure ML.
• Develop and optimize complex ETL/ELT processes for large-scale datasets using Spark and Python.
• Enhance Python job performance and cost-efficiency through advanced optimization techniques.
• Collaborate with data scientists, analysts, and business stakeholders to create technical solutions for business problems.
• Implement data security, compliance, and governance frameworks (e.g., Unity Catalog, access controls, encryption, data lineage).
• Champion DevOps and automation by building CI/CD pipelines using Azure DevOps, GitHub Actions, or Jenkins.
• Develop robust monitoring, logging, and alerting for production pipelines to ensure reliability.
• Must have strong experience in Databricks, Azure Cloud, Spark, and application development.
• Experience with software development life cycle (SDLC) and agile methodologies.
• Design and develop CI/CD pipelines for code deployment, preferably to Azure, using Git-based tools.
• At least 5 years of hands-on experience with Spark, Databricks, and monitoring/alerting systems.
• Nice to have: Java, Spring, comprehensive Azure services knowledge, and excellent communication skills.
• Experience using AI tools for enhanced productivity is a plus.
• Will work in a pod-based agile team structure, supporting multiple projects and ensuring consistent agile practices.
• Local candidates (within 50 miles of Fort Worth, TX) required; in-person interview and coding assignment mandatory.