Azure DevOps Data Engineer

Job Title : Azure Devops Data Engineer

Location : Trivandrum

About the Role :

We are seeking an experienced Lead Data Engineering (Azure) to join a high-performing data engineering team supporting enterprise-scale data platforms and modernization initiatives. The ideal candidate will possess strong expertise in Azure data services, data modeling, ETL/ELT development, data governance, DevOps, and cloud-based data engineering practices.

The role requires close collaboration with business stakeholders, architects, data analysts, QA teams, infrastructure teams, and production support teams to design, develop, deploy, and maintain robust data solutions.

Key Responsibilities :

Data Engineering &

• Development :
• Design, develop, and maintain scalable data pipelines using Azure cloud technologies.
• Support data acquisition, ingestion, transformation, and integration from multiple enterprise data sources.
• Develop and maintain ETL/ELT solutions using Azure Data Factory and Azure Databricks.
• Build efficient data processing frameworks using Python and PySpark.
• Implement Delta Live Tables and modern data engineering best practices.
• Create and maintain dimensional and relational data models based on business requirements.
• Develop reusable and scalable data assets for reporting, analytics, and downstream applications.

Data Analysis &

• Governance :
• Maintain foundational knowledge of source systems and upstream data.
• Perform data profiling, data quality analysis, and metadata management activities.
• Ensure compliance with enterprise data governance standards, policies, and guidelines.
• Support data lineage documentation and metadata management processes.
• Work with business stakeholders to understand and translate business requirements into technical data solutions.
• Assist users and business teams in interpreting and analyzing data.

Platform &

• Operational Support :
• Provide support during SIT, UAT, and production deployment activities.
• Troubleshoot and resolve data-related issues across environments.
• Support QA teams with test data preparation, validation, and analysis.
• Provide warranty and post-production support after application releases.
• Participate in release management and change management processes.
• Raise and track ServiceNow requests related to deployments and environment management.

DevOps &

• Release Management :
• Manage source code using enterprise version control repositories.
• Execute code check-in/check-out activities following source control best practices.
• Collaborate with Azure DevOps and infrastructure teams for CI/CD implementation.
• Support code packaging, deployment automation, and environment promotions.
• Participate actively in architecture reviews, design reviews, and deployment planning sessions.

Collaboration &

• Leadership :
• Communicate technical solutions effectively to both technical and non-technical stakeholders.
• Collaborate with architects, business analysts, QA teams, and production support teams.
• Contribute to data engineering standards, best practices, and process improvements.
• Support junior team members through technical guidance and knowledge sharing.

Required Skills &

Experience :

Azure Data Engineering :

• 5 years of experience with Azure Data Engineering technologies.
• Strong hands-on experience with :

1.

Azure

Databricks

2.

Azure Data

Factory (ADF)

3.

Delta Live

Tables

4.

Unity

Catalog

5.

Azure Data Lake

Storage (ADLS)

6.

Azure Data Platform

Services

Programming :

• Strong experience in :
• Python
• PySpark
• SQL

Data Management :

• Data Modeling (Dimensional &
• Relational)
• ETL/ELT Design and Development
• Data Quality Management
• Metadata Management
• Data Governance
• Data Lineage

DevOps &

• Deployment :
• 5 years of Azure DevOps experience
• CI/CD implementation and deployment automation
• Source Code Management
• Release Management
• Infrastructure and Environment Management

Data Integration Experience :

• Experience integrating data from sources such as :
• On-Premises SQL Databases
• TIBCO
• SharePoint

4.

Shared File

Systems

5.

Enterprise Data

Platforms

Preferred Qualifications :

• Banking or Financial Services domain experience.
• Experience working in large enterprise environments.
• Knowledge of enterprise data governance frameworks.
• Familiarity with regulatory and compliance-driven data platforms.
• Exposure to modern data lakehouse architectures.