Deepak Dhanigond
Software Engineer
Hire this person
Send a job offer directly to this candidate
About
Looking a challenging position as a Software engineer in a reputable company to enhance my ability and to develop my skills. Around 16 years of professional IT experience with 14 years in ETL Analysis, Design, Development, Testing and Implementation. 2 Years of Hadoop Admin Experience with responsibility of building Enterprise Hadoop Cluster HDP 2.X and day to day administration tasks.
Gained
Solid experience in the Analysis, Design, Development and Testing of Data warehousing solutions and in developing strategies for Extraction, Transformation and Loading (ETL) mechanism using Ab Initio. In-depth knowledge of UNIX shell scripting. Expertise in working Agile mythology such as SCRUM using Rally, Dev-ops environment and Waterfall mythology. Having good domain skills in Banking, Logistics and retail.
Experience
Business Analyst - Travelers Insurance - Connecticut
(2020-02 - 2024-09)
Snowflake, Python, and AWS, building reliable and scalable data pipelines. Interested in AI/ML data infrastructure, MLOps, and GenAI systems that power intelligent applications.
Systems Analyst - JP Morgan Chase - Columbus, Ohio
(2019-11 - 2020-11)
POC BIA Data lake project is to measure the developer's productivity which has close to 12000 developers in CCB (Consumer and Community Banking). The segment involved pulling data from JIRA and other tools (Team Central) to check the deliverables and story point calculation of the teams with drill down to Developer level
- Requirement Gathering, Effort Estimation and Analysis impact
- Work with the team of analysts, developers, testers and drive delivery of ETL Solutions
- Manage all aspects of a BI technical roadmap, including platform requirements
- Design of KPIs
- Worked with reports developer to understand their needs
- Responsible for data definitions
- Source system identification
Hadoop Administrator/Platform Support - Manulife - Toronto
(2018-04 - 2019-09)
- Responsible for building Enterprise Hadoop Cluster HDP 2.X and day to day administration tasks
- Co-ordinating with networking, infrastructure and development teams to ensure high availability
- Cluster maintenance including adding new nodes to existing cluster and realigned server components between master nodes based on requirements
- Add and remove nodes using Ambari
- Expanded cluster capacity from 18 nodes to 24 nodes by bringing new node into cluster (Add node operations) removed problem nodes for diagnostic and remedying
- Providing inputs to architecture team for capacity planning
- Working with Hortonworks support team for high severity tickets
- Collaborating with Enterprise application team to Install operating system and Hadoop updates, patches, version upgrades when required
- Driving initiative to automate the recurring manual activities for monitoring and operations using Unix Scripting
- Enabling High Availability for multiple server components
- Implemented Kerberos and AD security authentications
- Setup HDFS and Hive authorization using Ranger
- Automated code promotions/deployments using Ansible
Analyst / Developer - Scotiabank - Toronto
(2017-02 - 2018-03)
As a Tech Lead for the project to HollisWealth Migration. The business is moving from Scotia to Industrial Alliance, HW and some of the associate applications may no longer be needed. There are some Upstream Data feeds to HW corporate database which are still required up until certain point to meet compliance requirements. Some downstream data extracts/reports are still required to run as per business requirements.
- Production support for DCDB, Migration support for Migration of Holliswealth to Industrial Alliance
- Manage all aspects of a BI technical roadmap, including platform requirements and support for end-user BI tools
- Lead architect in development, design, execution, and implementation of complex dashboards and BI self-service solutions
- Worked on UNIX, Shell scripting in development and support of various existing shell scripts
- Work in conjunction on multiple use cases involving Hive/Hbase/HDFS/Kafka
- Partner with internal teams and vendor partners to provide technical leadership in order to develop and support effective BI solutions, performance tuning and reports
ETL Lead - Bank of Montreal - Toronto
(2013-07 - 2017-01)
Managed all ETL deliverables from the IBM Global resourcing team guiding onshore DEV leads, offshore DEV leads and supporting BAs in the work stream providing Business Analysis Support, Development and Production Deployment plan and reporting to client stakeholders. Work segment is in ETL part of Data Integration of Banks various lines of business from Mortgage, Everyday Banking, Lines of Credits, Investments, Loan Origination and supporting BASEL components that includes Bank Wide Asset reconciliation.
- Created Ab initio Graphs, Ab initio code review tuned them for better performance
- Worked on UNIX, Shell scripting in development and support of various existing shell scripts
- Created Naming conventions document for all the components
- Acted as team lead and key point of contact for the business for any production issues
- Managing any production issues raised and follow up with business and other vendors through to final resolution
- Created the UTC documents
- Worked with Ab Initio Multi File Systems (MFS) and complex ETL transformation
- Database Design, tuning, configuration Management
- Created and coded functional and business constraints, packages and triggers
ETL Developer/Semantic Modeler - Teradata Corporation - Toronto
(2011-11 - 2013-07)
Clients: Loblaws, Wind Mobile and McCain Foods
- Information Strategy Road Map
- Deliver a Roadmap
- Co-ordination of all the teams
- Involved in Semantic layer design
- Performance tuning BI applications
- Worked with reports developer to understand their needs of performance for report generation
- Responsible for data definitions
- Source system identification
- Worked with end users to define business requirements and needs, performing data validation
- Wrote Business rules mappings for ETL team for coding
Senior Ab Initio Developer - American Express - Salt Lake City, USA
(2010-07 - 2011-11)
This project takes input from TSYS US which is card processor platform used for authorizations and settlements of credit card data. Data that has passed through Amex, Master Card and VISA from merchants is processed here. Data is passed 5 days a week to CPS for additional processing and reporting.
TSYS Europe is the card processor platform used for authorizations and settlements of credit card data. Data that has passed through MC and VISA from merchants is processed here. Data is passed 5 days a week to GE CPS for additional processing and reporting.
- Analyze and understand complex business Requirements from High-level documents
- Estimate the effort for enhancement and development activities based on the complexity
- Create low-level design documents based on the HLD understanding and develop Ab Initio Graphs based on the requirements
- Create test plans and capture test results and review the results with business
- Periodically conduct code reviews to ensure that it meets the standards and best practices
- Highlight issues, concerns etc. at the earliest and do defect prevention/resolution activities
- Co-ordinate with the offshore development team and provide guidance to junior members of the team
- Involved with Performance tuning to decrease the run times
- Provided L1-L3 support to all the applications and handled the change management and incident ticket resolution
Senior Ab Initio Developer - FedEx - Memphis, USA
(2009-07 - 2010-07)
This project provides the processes, the engine to uniquely identify a business at a location or individuals at their business location that interact with FedEx at any level through touch points. The project covers the US-inbound, US-outbound shipping data. This helps the marketing/retail/sales and other business users to identify unique individuals and businesses that interact with FedEx without account numbers.
Helps functional areas such as Sales, Marketing, Retail understand the various roles.