ข้ามไปยังเนื้อหาหลัก
Chommanee Rujijanagul

Chommanee Rujijanagul

Junior Data Engineer

ผู้มีความสามารถ
Bangkokเป็นสมาชิกตั้งแต่ 8 พฤษภาคม 2569
PythonSQLJavaPySparkDelta LakeApache AirflowKafkaPandasGreat ExpectationsPytestSonarQubeMicrosoft AzureMinIOPostgreSQLTableauOpenTelemetryPrometheus
·

จ้างคนนี้

ส่งข้อเสนองานโดยตรงถึงผู้สมัครนี้

PythonSQLJavaPySparkDelta Lake

เกี่ยวกับ

Data Engineer with 1+ year of experience in building ETL/ELT pipelines, data quality checks, and real-time data streaming. I have worked with Python, PySpark, and Apache Airflow in both cloud (Azure) and on-premise setups. I pay attention to detail, adapt well to new environments and requirements, and manage my work to make sure deliverables are done on time.

ประสบการณ์

Data Engineer at Viriyah Insurance (2025-11 – 2026-02)

  • Received and profiled data from a cleansing zone to understand data structure and define column-level validation rules, working extensively with regex to validate formats such as names, dates, and identification numbers.
  • Built a data quality framework using Great Expectations and Pandas to run validation checks across 100,000 rows, flagging each record with a specific cause of error to make future debugging straightforward.
  • Developed a deduplication pipeline to identify unique customers by ID card, identifying the most reliable record per customer and storing duplicates in a separate storage layer for further review.
  • Built a data integration pipeline that merged customer data from multiple sources including Line OA and OIC with OCR-processed records, then determined source reliability to select the most trustworthy data per customer.
  • Designed flowcharts for each pipeline process and wrote technical documentation upon completion, making the system easier for others to understand and maintain.

Data Engineer at Entronica (Outsourced to AIS) (2024-09 – 2025-10)

  • Built and improved ETL/ELT pipelines using Python, PySpark, and Delta Lake for both cloud and on-premise environments.
  • Worked with Apache Airflow to configure pipeline schedules and manage task dependencies, ensuring consistent and timely data delivery across workflows.
  • Implemented data synchronization on Microsoft Azure, publishing validated structured data to Confluent Kafka for real-time streaming to downstream systems.
  • Built on-premise ETL jobs using MinIO and NAS, reusing the same transformation logic across different setups to keep data consistent.
  • Created a metadata tracking system with PostgreSQL to prevent duplicate ingestion and track data lineage across pipelines.
  • Integrated observability (OpenTelemetry, Prometheus) to monitor pipeline health and improve incident visibility.
  • Wrote unit tests with Pytest and used SonarQube to check code quality, keeping test coverage above 50% and code duplication below 3%.
  • Tuned PySpark jobs with better partitioning and caching to handle 3M+ records reliably in each pipeline run.

การศึกษา

Bachelor in Computer Engineering – Chiang Mai University (2020 – 2024)

ทักษะ

Junior Data Engineer

รีวิว

ที่เกี่ยวข้อง