
Chommanee Rujijanagul
Junior Data Engineer
ผู้มีความสามารถ
Bangkokเป็นสมาชิกตั้งแต่ 8 พฤษภาคม 2569
PythonSQLJavaPySparkDelta LakeApache AirflowKafkaPandasGreat ExpectationsPytestSonarQubeMicrosoft AzureMinIOPostgreSQLTableauOpenTelemetryPrometheus
·
จ้างคนนี้
ส่งข้อเสนองานโดยตรงถึงผู้สมัครนี้
PythonSQLJavaPySparkDelta Lake
เกี่ยวกับ
Data Engineer with 1+ year of experience in building ETL/ELT pipelines, data quality checks, and real-time data streaming. I have worked with Python, PySpark, and Apache Airflow in both cloud (Azure) and on-premise setups. I pay attention to detail, adapt well to new environments and requirements, and manage my work to make sure deliverables are done on time.
ประสบการณ์
Data Engineer at Viriyah Insurance (2025-11 – 2026-02)
- Received and profiled data from a cleansing zone to understand data structure and define column-level validation rules, working extensively with regex to validate formats such as names, dates, and identification numbers.
- Built a data quality framework using Great Expectations and Pandas to run validation checks across 100,000 rows, flagging each record with a specific cause of error to make future debugging straightforward.
- Developed a deduplication pipeline to identify unique customers by ID card, identifying the most reliable record per customer and storing duplicates in a separate storage layer for further review.
- Built a data integration pipeline that merged customer data from multiple sources including Line OA and OIC with OCR-processed records, then determined source reliability to select the most trustworthy data per customer.
- Designed flowcharts for each pipeline process and wrote technical documentation upon completion, making the system easier for others to understand and maintain.
Data Engineer at Entronica (Outsourced to AIS) (2024-09 – 2025-10)
- Built and improved ETL/ELT pipelines using Python, PySpark, and Delta Lake for both cloud and on-premise environments.
- Worked with Apache Airflow to configure pipeline schedules and manage task dependencies, ensuring consistent and timely data delivery across workflows.
- Implemented data synchronization on Microsoft Azure, publishing validated structured data to Confluent Kafka for real-time streaming to downstream systems.
- Built on-premise ETL jobs using MinIO and NAS, reusing the same transformation logic across different setups to keep data consistent.
- Created a metadata tracking system with PostgreSQL to prevent duplicate ingestion and track data lineage across pipelines.
- Integrated observability (OpenTelemetry, Prometheus) to monitor pipeline health and improve incident visibility.
- Wrote unit tests with Pytest and used SonarQube to check code quality, keeping test coverage above 50% and code duplication below 3%.
- Tuned PySpark jobs with better partitioning and caching to handle 3M+ records reliably in each pipeline run.
การศึกษา
Bachelor in Computer Engineering – Chiang Mai University (2020 – 2024)
ทักษะ
Junior Data Engineer


