Lucky Rai

Results-driven Azure Data Engineer with 5 years of experience in designing, developing, and optimizing cloud-based data solutions. Expertise in Azure Databricks, Azure Data Factory (ADF), Azure SQL Database, Azure Data Lake and Azure Key Vault etc. Skilled in ETL/ELT pipeline development, unity catalog implementation, data modeling and data warehousing. Proficient in Python, Databricks SQL, Apache Spark and PySpark for data transformation and analysis.

Lead Associate - Data Engineer - WNS Global Services Pvt. Ltd.

(2023-10)

• Implemented Unity Catalog using Storage Credential, External Table Locations, and Volumes, ensuring secure and efficient data access management for different user groups.
• Executed end-to-end MMP data validation, data mapping, unwanted data filtration, data aggregation, and final table management to ensure accurate, structured, and analytics-ready datasets for reporting and business insights.
• Designed and implemented a data warehouse using Delta Tables, migrating data from file-based storage in a data lake. This transformation enhanced data storage efficiency and significantly improved data retrieval performance, boosting team productivity.
• Automated ETL/ELT Process & data ingestion into the data warehouse using Azure Data Factory pipelines, scheduled triggers, and Databricks notebooks.
• Provided Power BI direct query connection to load data in dashboard and migrated complex Power BI transformations to Databricks, improving dashboard performance.
• Developed Data Extraction databricks notebook leveraging input widgets for users to extract and store data into data lake in parquet and csv file formats.
• Maintained all pipeline logs in Azure SQL Database.
• Configured Azure Data Share to enable Snapshot-Based Sharing of data in the modeler's environment.

Data Engineer - I - ConvertCart Pvt. Ltd.

(2022-06 - 2022-12)

• Worked on Recommendation System & Involved in transforming, analyzing, and reporting the e-commerce data of products and customers on the report dashboard to predicate the customer's behavior and increase the conversion rate resulting in high revenue.

Project Engineer - Wipro Technologies Ltd.

(2020-11 - 2022-02)

• Worked on Quarterly Mastercard Reporting (QMR) web app to process and analyse financial data so that we can enhance the customer experience.

Bachelor of Engineering (B.E) - Computer Science & Engineering (CSE) - Gyan Ganga College of Technology, Jabalpur (M.P) (2016 - 2020)