Data Platform Engineer

About The Opportunity

At Avenue Code, we are passionate about transforming businesses through technology. We are a leading end-to-end development consultancy for digital transformation across various markets, growing sustainably since day one. We believe that great results are born from strong relationships. Our team combines technical expertise, collaboration, and a welcoming approach to work that makes all the difference.

We are looking for a Data Engineer with a platform mindset to help build and scale a modern lakehouse on AWS, using Iceberg, Spark, Kafka, and Trino. The platform supports experimentation across the company, so your work will directly shape how teams run experiments and use data to make decisions. The role is hands-on, with real ownership and a lot of collaboration with other teams.

Responsibilities

• Build and operate a lakehouse on S3 using Parquet and Apache Iceberg.
• Develop data transformations with Spark (Python, SQL, Scala).
• Build backend services in Go, Scala, or Java.
• Design and support streaming pipelines with Kafka.
• Deploy services on Kubernetes and manage access control with AWS IAM.
• Build tools and data products that make experiment design and analysis more reliable.

Required Qualifications

• Degree in Computer Science, Engineering, or a related field.
• Solid experience in platform or data platform engineering, including work on experimentation platforms.
• Production-level coding in Python, Go, and Scala or Java.
• Hands-on experience supporting Iceberg-based data warehouses or lakehouses.
• Proven experience building and supporting RBAC systems used by teams across the company.
• Strong knowledge of Spark, Kafka, and AWS (S3, IAM).
• Experience running services on Kubernetes.
• Strong ownership, communication skills, and ability to work with multiple teams.
• Advanced to fluent English for daily communication with international teams.

Avenue Code reinforces its commitment to privacy and to all the principles guaranteed by the most accurate global data protection laws, such as GDPR, LGPD, CCPA and CPRA. The Candidate data shared with Avenue Code will be kept confidential and will not be transmitted to disinterested third parties, nor will it be used for purposes other than the application for open positions. As a Consultancy company, Avenue Code may share your information with its clients and other Companies from the CompassUol Group to which Avenue Code's consultants are allocated to perform its services.