Luccio Lee

A Chemical Engineer with experience in Data engineering projects, who, for more than 3 years, develops and maintain data pipelines projects and tools with Python using Airflow and Docker in Cloud environments applications for a better data-driven decision making in business and has some API building experience in Golang.

At PierCloud (from nov/23 to jul/24), i worked as an Data Engineer and did two main projects:

Project Dexter: Developed and implemented ELTL pipelines with Python from many cloud sources (GCP, Azure, AWS,…) with Airflow orchestrator in an ECS and EC2 envirorment. The orchestrator deployed EMR clusters to execute Python Scripts to read, load and enrich data with Spark

Project Auth: Developed and implemented an Authenticator API for services acess with Golang and Keycloak to manage keys.

Also migrated some legacy code.

At Selia Full Commerce (from may/23 to jan/24), i worked as an Data Engineer and did two main projects:

Project Integration: Developed and implemented ETL pipelines with Python to obtain data from many sources (API's like shopfy) to feed an datamart with Airflow as an orchestrator and AWS-Batch with python containers (ECS) for small jobs.

Project finance: Developed a tool to calculate customer charges in Python and SQL.

I also migrated many ETLs from Nifi to Python and maintained legacy projects

BSc – Chemical engineering @ University of São Paulo (2019)