Linux / Big Data Platform Engineer

We are looking for a Linux System Engineer with strong experience in Big Data environments to support and operate a Cloudera/Hadoop-based data platform in production.

Role Overview

You will be responsible for operating, monitoring and supporting a large-scale Big Data infrastructure, ensuring stability, performance, security and automation across the platform lifecycle. The role has a strong hands-on and L3 support component.

Key Responsibilities

• Operate, monitor and support Cloudera/Hadoop production environments.
• Provide L3 incident response, deep troubleshooting and performance tuning.
• Automate operational tasks using Python and Ansible (monitoring, alerting, deployments, configuration).
• Manage HDFS clusters, ensuring data integrity, replication and capacity planning.
• Develop and maintain monitoring and alerting for services and node health.
• Onboard new workloads in collaboration with platform and data teams, ensuring correct resource allocation.
• Apply patches, upgrades and configuration changes to ensure platform security and stability.
• Manage security components: Kerberos authentication, Ranger/Sentry policies and TLS encryption.
• Work with storage, network and security teams to optimize performance, access control and backup strategies.
• Maintain technical documentation and promote knowledge sharing within the team.

Required Skills & Experience

• Strong Linux System Engineering background.
• Proven experience working in Big Data environments.
• Hands-on experience with Hadoop / Cloudera ecosystems and Data Lake operations.
• Experience with Big Data services and query engines.
• Solid knowledge of monitoring, automation and platform lifecycle management.
• Experience diagnosing and resolving complex Big Data platform issues.
• Scripting and automation skills (Python, Ansible).

Nice to Have

• Experience in enterprise-scale production environments.
• Familiarity with security, networking and storage concepts in Big Data platforms.

Hybrid role, 2/3x days per week on-site at Parque das Nações, Lisbon.