Narin Meher

Over 5 years of experience in leading Big Data technologies, I excel as a skilled Data Engineer. My proficiency lies in designing and implementing data-driven solutions using various data processing tools like Hadoop ecosystem, Apache Spark, StreamSets and GCP. My adeptness extends to leveraging these tools for crafting both batch and streaming ETL pipelines. I am a computer engineering expert with a Postgraduate Diploma in Big Data Analytics from CDAC (India).

• Engineer, CV Parser in ERPNext, bigspark ltd
• Integrated a machine learning script into ERPNext for CV parsing and skills extraction.
• Deployed an ML model to AWS SageMaker to automate CV parsing, utilizing endpoints and Lambda functions.
• Data Engineer, SARs Data Automation, NatWest Group, bigspark ltd
• Developed a customizable, fault-tolerant JDBC framework using StreamSets, Snowflake, and AWS S3, reducing coding time for systems.
• Orchestrated, scheduled, and monitored complex workflows using AutoSys and Apache Airflow.
• Proficient in data modeling within Snowflake for tailored report creation.
• Data Engineer, Merchant Portal, TSYS - A Global Payment Company
• Resolved production defects and enhanced requirements.
• Designed and executed end-to-end ETL pipelines on Google Cloud Platform, utilizing Dataflow (Java SDK), PubSub, and BigQuery for batch and streaming data processing.
• Successfully migrated on-premise ETL pipelines to Google Cloud Platform, reducing on-premise costs by 70%.
• Big Data Developer, HDP based Consolidation ETL Tool, IBM, Alphonso Global Solutions
• Developed a reusable Python framework for data warehouse to datalake migration, reducing report generation time by 50%.
• Orchestrated ETL pipelines for various schedules using Pyspark for data processing and storage in Hive tables or files.
• Extracted data from diverse sources and applied transformation logic using Pyspark.
• Big Data Developer, Online and Offline Subscriber De-duplication, IBM, Alphonso Global Solutions
• Built high-performance, distributed pipelines for data loading and processing using Spark (Scala), Spark Streaming, Hive, HBase, Kafka, and Redis, reducing data processing time by 50%.
• Developed shell scripts for SQL data extraction and ingestion into HDFS.
• Automated daily and monthly data loading jobs with Oozie workflows, reducing manual effort.

PGD in Big Data Analytics - Centre for Development of Advanced Computing, CDAC, Pune -

February -18

Bachelor of Engineering in Computer Science - NBN Sinhgad School of Engineering, Pune - June - 17