Lai Dang

Data Engineer with 5+ years building large-scale pipelines and real-time streaming systems on AWS, Azure, and GCP. Specialises in Databricks, Spark, and Kafka, with strong DevOps and cloud-infrastructure expertise. Consistently translates complex data challenges into reliable, high-performance solutions.

VinSmart Future May 2025 - Present

• Designed, built, and maintained scalable data pipelines to deliver reliable, analytics-ready datasets.

• Collaborated with product, backend, and analytics teams to integrate data across multiple systems and translate business requirements into technical solutions.

• Optimized data pipeline performance, reliability, and operational efficiency while troubleshooting complex production issues.

• Automated data workflows, infrastructure, and deployment processes using modern cloud and DevOps practices.

Dragon Capital Apr 2024 - May 2025

• Built and maintained Azure Data Factory pipelines to schedule and run daily jobs generating market reports, ensuring data freshness and accuracy for investment teams.

• Automated crawled-data delivery from Bloomberg/Reuters-style terminals to third-party systems via PowerShell scripts, reducing manual data handling and turnaround time.

• Built a Python application to export data to Word, Excel, and PDF for reporting, standardizing report formats across departments.

• Monitored and troubleshot ADF pipeline failures and data quality issues, coordinating with stakeholders to resolve upstream data source problems.

SimpleVen Apr 2022 - Jan 2024

• Deployed cloud infrastructure as code with Terraform, Terragrunt; built a data platform on Kubernetes using Helm.

• Optimized database performance through advanced query tuning.

• Developed the customer-facing web application using PHP, Laravel, Livewire, Bootstrap, and built RESTful APIs to support the mobile app; containerized and operated reporting jobs using Docker.

GeoComply Feb 2022 - Jan 2023

• Processed tens of millions of records daily to detect coordinate/location-based compliance violations, building tailored pipelines across MySQL, Elasticsearch, and MongoDB for Data Science and Analytics teams.

• Designed and scheduled automated ETL workflows using Apache Airflow to orchestrate large-scale data processing.

• Developed Python-based scheduled jobs to crawl, download, and extract data from scanned financial reports submitted to U.S. regulatory systems.

• Stored large datasets in Parquet format on Amazon S3, optimizing storage efficiency and query performance for downstream analytics.

FUNiX Academy Apr 2022 - Jan 2023

• Automated visually appealing reports using Google Apps Script.

• Recommended a NoSQL database for higher performance.

B.Sc. - Software Engineering - Nguyen Tat Thanh University (2018 - 2021)

Certificate - Data Engineer - FUNiX Academy (2021 - 2022)

Certificate - Software Engineer - Cybersoft Academy (2020)