Mohammad Asharaf
Sr. Data Engineer
Hire this person
Send a job offer directly to this candidate
About
Sr. Data Engineer at Bluepi consulting pvt. Ltd., a Databricks Certified Associate Data Engineer with 2+ years of experience in Bigdata domain(Spark). Experience Bigdata Technologies i.e Pyspark, Spark-SQL, SQL, Databricks, ADF. Familiar with ETL,extensively worked on data extraction, transformation, cleansing, loading and real time analytics.
Experience
a Sr. Data Engineer with experience at multiple organizations, specializing in cloud-based data engineering solutions. Your professional journey includes:
Bluepi Consulting Pvt. Ltd., Gurgaon (Oct 2023 - Current)
- Role: Sr. Data Engineer
- Responsible for moving files from SQL Servers and Oracle to Azure Databricks using Azure Data Factory (ADF), and handling the complete ETL process. You create generic notebooks in Databricks for data validation, improve data quality, reliability, and efficiency, and develop Python-based User Defined Functions for specific requirements.
- Tools: Databricks, PySpark, ADF, Lakehouse, Unity Catalog, CDC
- Role: Data Engineer (Contract-based)
- Worked on implementing data warehouse concepts, including dimension and fact tables, and improving the quality and reliability of Delta Tables in Azure Data Factory. You handled pipelines, triggers, and connection strings, and created Python-based Notebooks for specific tasks.
- Role: Associate Data Engineer
- Focused on ETL processes, data validation, and improving data quality using Databricks, PySpark, and Azure Data Factory for global clients in the financial services and manufacturing sectors.
Education
You have a Bachelor of Technology (B.Tech) degree in Computer Science, which provided a strong foundation in software development, data structures, algorithms, computer systems, and programming. Your education is closely aligned with your work in data engineering, big data technologies, and cloud platforms like Azure, further strengthening your technical expertise in these areas.