Nghi Le
Data Engineer
Sewa orang ini
Hantar tawaran kerja terus kepada calon ini
Tentang
Contributing to the design and development of SparkOne, a unified data processing platform combining Kubernetes, DataBrick, and Amazon EMR into a single application layer. Supported the migration of ~5,000 Spark jobs from legacy Spark pipelines to SparkOne, leveraging AI-assisted migration tools to accelerate conversion and ensure correctness. Built and enhanced a centralized data ingestion platform using Django, integrating Scala-based processing jobs (JAR) for data transformation and JDBC-based database updates, enabling reliable and scalable ingestion pipelines from database source to Amazon S3
Pengalaman
Middle Data Engineer - Grab - Ho Chi Minh City
(2025-07)
- Contributing to the design and development of SparkOne, a unified data processing platform combining Kubernetes, DataBrick, and Amazon EMR into a single application layer.
- Supported the migration of ~5,000 Spark jobs from legacy Spark pipelines to SparkOne, leveraging AI-assisted migration tools to accelerate conversion and ensure correctness.
- Built and enhanced a centralized data ingestion platform using Django, integrating Scala-based processing jobs (JAR) for data transformation and JDBC-based database updates, enabling reliable and scalable ingestion pipelines from database source to Amazon S3
- Researched and implemented migration from Hive tables to Apache Iceberg, improving and reducing data ingestion run time by 30% - 80% through optimized table formats and incremental data handling
Middle Data Engineer - FPT Software - Ho Chi Minh City
(2024-09 - 2025-07)
- Contributed to designing the rearchitecture of a legacy data pipeline, migrating from Node.js on EC2 to a scalable solution using AWS Glue and Apache Spark.
- Developed end-to-end ingestion pipelines integrating Redshift, PostgreSQL, and Azure SQL into a unified data lake solution.
- Assisted the client in resolving support tickets related to application data quality, testing, and business logic
Data Engineer - Sipher Odyssey - Ather Labs - Ho Chi Minh City
(2023-09 - 2024-09)
- Built pipelines to streamline data workflows across blockchain, gaming, and marketing domains.
- Migrated ETL processes to Linux VM, reducing operational cost and improving integration efficiency.
- Developed monitoring system for performance visualization and system reliability.
- Created dashboards with Looker Studio to deliver actionable insights to stakeholders.
- Optimized SQL queries for better game server performance and data load times.
- Collaborated on building a microservices architecture and designing core business logic.
- Supported game server development and maintained backend features using NestJS and Node.js.
Junior Backend Developer - Gameloft - Ho Chi Minh City
(2022-05 - 2023-05)
- Supported game server development and maintained backend features using NestJS and Node.js.
- Optimized SQL queries for better game server performance and data load times.
- Collaborated on building a microservices architecture and designing core business logic.
- Worked cross-functionally to fix bugs, upgrade features, and ensure service stability.
Top Rated Data Engineer / Python Developer - Freelancer | Upwork - Freelance
(2023-01)
- Designed and built end-to-end data pipelines using Apache Airflow, DBT, and various integration tools.
- Contributed to projects involving data crawling and ingestion using Dagster and DBT for data pipelines.
- Expertise in Python for web scraping and automation.
- Maintained a 100% Job Success Score with consistent 5-star ratings for clear communication, reliability, and high-quality delivery.
Pendidikan
Bachelor's Degree - Ho Chi Minh University of Economics and Laws (2019 - 2023)
Nguyen Thuong Hien High School For The Gifted (2015 - 2018)




