Ömer Feyzioğlu

Architected PySpark and Apache Kafka ETL pipelines and added API-driven health checks for Kafka Connect sink connectors to improve data reliability and operational visibility. Modernized platform storage by migrating validated HDFS workloads from on-premises storage to AWS S3. Led the Apache Airflow v2-to-v3 migration on Kubernetes, including environment setup, deployment configuration, and refactoring production DAGs for v3 compatibility.

Big Data Engineer at Doguş Teknoloji, Big Data & Cloud Data Technologies (2025-07 – 2026-06)

• Architected PySpark and Apache Kafka ETL pipelines and added API-driven health checks for Kafka Connect sink connectors to improve data reliability and operational visibility.
• Modernized platform storage by migrating validated HDFS workloads from on-premises storage to AWS S3.
• Led the Apache Airflow v2-to-v3 migration on Kubernetes, including environment setup, deployment configuration, and refactoring production DAGs for v3 compatibility.
• Managed Apache Spark batch jobs in Apache Airflow, including retries, backfills, dependency checks, and failure notifications.
• Orchestrated repeatable releases with Helm, Kubernetes, and Azure DevOps CI/CD pipelines, reducing manual deployment work across data services.
• Improved production data reliability by implementing SQL-based anomaly detection checks and centralizing secret management through Azure DevOps Library and Airflow Connections.

BSc in Software Engineering (English) – Sakarya University (2021 – 2026)