Thet Myat
Data Engineer | PySpark | SQL | Databricks | AWS
Hire this person
Send a job offer directly to this candidate
About
Data Engineer with 2+ years of hands-on experience designing, building, and maintaining scalable cloud-based data platforms and ETL pipelines using AWS, Databricks, PySpark, and SQL. Experienced in implementing Bronze–Silver–Gold data architectures, processing high-volume event streaming data (100K+ daily events), and integrating API-based and event-driven data sources to support product analytics and business intelligence. Strong expertise in batch and near real-time data processing, data quality management, schema evolution, automation, and cloud data lake solutions.
Proven ability to transform complex datasets into reliable, analytics-ready data assets and actionable insights through dashboards and reporting. Supported by academic training in Data Science, Machine Learning, Statistics, Business Analytics, and software development, with a passion for building scalable data solutions that drive business value.
Experience
Data Engineer - YomaFleet - Hybrid (On-site Myanmar / Remote Singapore)
(2023-08 - 2025-12)
- Designed and maintained scalable Bronze–Silver–Gold data lake architecture using Databricks, PySpark, Delta Lake, and AWS S3 to support enterprise analytics and reporting.
- Built and optimized ingestion pipelines for Amplitude event streaming data, processing 100K+ daily events stored in hourly and daily partitions on AWS S3.
- Developed ETL pipelines for application analytics data (installs, uninstalls, versions, and locations) from Google Play Store, Apple App Store, and Huawei AppGallery APIs, integrating multiple sources into a unified analytics platform.
- Implemented data transformation, schema evolution, SCD Type 2 logic, and partitioning strategies to improve historical tracking, scalability, and query performance.
- Developed curated Gold-layer datasets in partitioned Parquet format and optimized Spark workloads through query tuning and efficient data modeling.
- Established automated data quality validation frameworks, ensuring accuracy, consistency, and reliability across multiple production datasets and business projects.
- Designed and maintained 5 key analytics dashboards comprising 100+ charts and visualizations using Databricks SQL, Amplitude, Power BI, and Tableau, presenting insights to BI teams and senior stakeholders, including the Head of IT.
- Defined and managed 2,000+ product analytics tracking events across 3 mobile applications and 5 web applications, collaborating with product and engineering teams to enhance user behavior analytics and business decision-making.
Education
Graduate Diploma - Data Science - University of London (2024 - 2026)
B.Sc (Hons) - Computing - University of Greenwich (2020 - 2023)