تخطي إلى المحتوى الرئيسي

Senior Data Engineer

Technology
BigData Technology Solutions
دبي, الإمارات العربية المتحدةمنذ شهر
عقد خدمات

وصف الوظيفة

Key Responsibilities

  • Support and maintain enterprise data engineering, ETL, data quality, metadata, and governance platforms.
  • Develop, monitor, troubleshoot, and optimize Informatica workflows, mappings, applications, and data pipelines.
  • Administer Informatica domains, nodes, repositories, Integration Services, and related application services.
  • Support Informatica PowerCenter, BDM or DEI, IDQ, and EDC or Axon components in production and non-production environments.
  • Investigate failed jobs, data-quality exceptions, performance issues, and platform incidents; complete root-cause analysis and implement appropriate corrective action.
  • Support Cloudera Hadoop services and data processing across HDFS, Hive, Spark, and PySpark workloads.
  • Perform deployments and migrations across development, quality assurance, user acceptance testing, and production environments.
  • Use Linux, shell scripting, and SQL to automate routine tasks, validate data, and troubleshoot platform issues.
  • Support user access, security, and permissions in line with established controls and operating procedures.
  • Coordinate incident resolution and planned changes with application, database, infrastructure, business intelligence, and business stakeholders.
  • Maintain accurate operational documentation, handover notes, change records, and support procedures.

Skill Requirement

Informatica

  • PowerCenter and BDM or DEI; administration of domains, nodes, repositories, Integration Services, and application services; ETL development, monitoring, troubleshooting, and performance tuning; IDQ; EDC or Axon.
Big Data
  • Cloudera or Hadoop; HDFS; Hive; Spark or PySpark.

Core Platform Skills

  • Linux or Unix; shell scripting; advanced SQL; Oracle or Microsoft SQL Server; data warehouse or data lake environments; enterprise production support.
  • Informatica MDM or IICS
  • Kafka, Impala, NiFi, Kerberos, or Ranger
  • Python
  • Microsoft Azure, Azure Data Factory, Databricks, or Snowflake
  • Power BI, Vertica, or Kubernetes

Experience

  • 10+ years of relevant experience in data engineering, Informatica development, Informatica administration, or closely related roles.
  • Strong hands-on experience supporting enterprise production environments and resolving data-platform incidents independently.
  • Demonstrated experience across both Informatica and Cloudera or Hadoop environments.
  • Experience working with high-volume data pipelines, data warehouses, or data lakes.
  • Exposure to UAE or GCC enterprise or government environments is advantageous.
Keywords
monthsOfExperience: 120UnixApache HadoopApache KafkaApache SparkMicrosoft SQL ServerMetadataLinuxRangerUAEOracle DatabaseAcceptance testingPythonSqlHiveHadoopBig dataNodeToolchainShell script

هل أنت مهتم بهذه الوظيفة؟