Senior Big Data Engineer
Technology
القاهرة القاهرة الجديدة مصر, مصرمنذ 2 أشهر
دوام كامل
وصف الوظيفة
About the job
- Support and maintain enterprise Data Lake and Cloudera platforms to ensure high availability and optimal performance.
- Participate in the design, implementation, and enhancement of data integration and analytics solutions.
- Contribute to strategic initiatives involving Data Lake modernization, platform upgrades, and infrastructure optimization.
- Develop and maintain data pipelines using technologies such as Apache NiFi, Kafka, and Airflow.
- Monitor platform health, troubleshoot production issues, and provide timely resolution for critical incidents.
- Collaborate with cross-functional teams to deliver data-driven solutions and business insights.
- Support and enhance online monitoring platforms and data quality frameworks.
- Analyze business requirements and translate them into scalable BI and reporting solutions.
- Create and maintain technical documentation, operational procedures, and best practices.
Required Qualifications
- 3 to 5 years of experience in Business Intelligence, Big Data, or Data Engineering environments.
- Hands-on experience with Cloudera Data Platform (CDP) or Hadoop ecosystem technologies.
- Strong knowledge of Apache NiFi, Kafka, Airflow, and data pipeline orchestration.
- Experience working with SQL and large-scale data processing platforms.
- Good understanding of Linux/Unix administration and troubleshooting.
- Knowledge of Data Lake architectures, data warehousing concepts, and BI solutions.
- Experience in system monitoring, performance tuning, and production support.
- Strong analytical, problem-solving, and communication skills.
Preferred Qualifications
- Experience in Data Lake migration or modernization projects.
- Exposure to cloud-based data platforms and analytics solutions.
- Knowledge of automation, monitoring, and incident management tools.
- Telecommunications industry experience is a plus.
Keywords
monthsOfExperience: 36UnixOrchestrationApache HadoopApache KafkaLinuxAirflowSqlHadoopApache LicenseApache Http ServerBig dataSystem monitor
هل أنت مهتم بهذه الوظيفة؟