Databricks Devops Engineer

Databricks DevOps Engineer – Azure | Terraform | CI/CD

📍 Location: Dallas, TX

💼 Experience: 6–12 years

🏢 Employment Type: Full-Time

Job Overview

We are looking for an experienced Databricks DevOps Engineer with strong expertise in Azure, Databricks, CI/CD, Terraform, API development, and DevOps automation. The ideal candidate will have hands-on experience building and integrating APIs, developing Terraform modules, and implementing automated CI/CD pipelines.

Must-Have Skills

• 7+ years of experience in API development and 3rd-party API integrations
• Strong SQL skills – SQL Server or Oracle
• Strong scripting experience with Python, Bash, and/or PowerShell
• Experience with Git, GitHub, and/or GitLab
• Strong understanding of CI/CD pipelines and DevOps best practices
• Hands-on experience with Azure Databricks
• Strong experience with Terraform and Terraform module development
• Experience with Jenkins and GitLab CI/CD
• Experience with Azure services and security
• Experience with:
• Azure AD / Microsoft Entra ID
• OAuth
• JWT
• Azure AD B2C
• App Registrations
• Azure App Insights
• AKS
• SignalR
• Microsoft Teams SDK
• Teams application development
• Azure Bots / Bot Framework

Preferred / Nice-to-Have

• Data Engineering experience
• Strong understanding of ETL/ELT
• Data modeling
• Data warehousing
• Big data concepts
• Workflow automation experience

Key Responsibilities

• Design, develop, and maintain APIs and integrations with third-party applications.
• Develop and maintain CI/CD pipelines using Jenkins and GitLab CI/CD.
• Build and maintain reusable Terraform modules and infrastructure automation.
• Support and manage Azure Databricks environments.
• Implement DevOps automation and deployment best practices.
• Work with Azure authentication and authorization technologies including Azure AD, OAuth, JWT, and Azure AD B2C.
• Support Azure services including AKS, App Insights, SignalR, and App Registrations.
• Collaborate with data engineering teams on ETL/ELT and Databricks-related initiatives.
• Troubleshoot technical issues and provide effective solutions across development and deployment environments.

Ideal Candidate The ideal candidate combines DevOps + Azure + Databricks + Terraform expertise with strong API development and scripting skills. Excellent analytical, troubleshooting, communication, and problem-solving skills are required.