Senior Data Engineer
Tecnología
E-ITHace 4 semanas
Profesional independientePresencial
Descripción del puesto
Senior Data Platform Engineer – Apache Flink
Location: Remote (Mexico/Argentina)
Type: Contract
Job Description
We are looking for a Senior Data Platform Engineer with strong experience in real-time data streaming, distributed systems, and cloud-based data pipelines. The candidate will build and maintain scalable ETL pipelines using Apache Flink, Apache Kafka, and CDC technologies.Key Responsibilities
- Build and maintain end-to-end streaming data pipelines.
- Develop and troubleshoot real-time processing jobs using Flink and Kafka.
- Implement CDC ingestion using Debezium or similar technologies.
- Design SQL queries, schemas, and data contracts.
- Deploy and troubleshoot workloads on Kubernetes.
- Implement checkpointing, fault recovery, monitoring, and automated testing.
- Collaborate with downstream teams to ensure reliable data delivery.
- 5+ years of experience building production streaming data pipelines.
- Hands-on experience with Apache Kafka and Flink or similar technologies.
- Strong knowledge of SQL, CDC, and distributed systems.
- Experience with stream processing, checkpointing, and fault tolerance.
- Experience deploying applications on Kubernetes or similar platforms.
- Strong debugging, testing, and cross-team collaboration skills.
- Debezium and log-based CDC.
- OLAP databases such as StarRocks, ClickHouse, Druid, or Pinot.
- Cloud data platforms and multi-tenant SaaS environments.
- AI-assisted development tools.
Keywords
data-platformflinkjob-descriptionsstreaming-datadata-pipelinetroubleshootingtime-and-attendancekafkacenters-for-disease-control-and-prevention-cdcchange-data-capturedebeziumplanning-and-designvisual-art-designproduct-development-and-designsqlkubernetesrepair-and-recoverytesting-and-analysisautomation-testingdistributed-computing
¿Te interesa este puesto?