Data Engineer
BBIJob description
Develop, deploy, and maintain robust data pipelines and ETL processes using Databricks and PySpark to ingest, process, and transform enterprise grade large-scale datasets
Design and implement data integration workflows and orchestration using Azure Data Factory to automate data movement across diverse sources and destinations
Monitor, troubleshoot, and enhance data pipeline performance (optimize for cost as well), ensuring data quality, security, and compliance with organizational standards
Integrate data solutions with Client’s DQ framework
Experience with develop and execute unit test cases/SIT cases and test plans in ADO or a testing tool
Support with resolution of UAT defects Preferred: Develop reports and dashboards using PowerBI We are hiring for Data Engineering roles at Levels L1, L2, and L3. Candidates with 1 to 10 years of experience in data engineering are encouraged to apply
¿Te interesa este puesto?