Hadoop admin
Send a job offer directly to this candidate
Conduct performance testing and monitoring of production systems.
Knowledge of Hadoop main components and Architecture such as HDFS, YARN,
MapReduce, Sqoop, Hive,Ranger, Knox, Kafka, Hbase, Kerberos etc.
Handled importing of data from various sources, and loaded data into HDFS.
Installed and configured Kerberos secutiry authentication.
UsedHIVE to read,write and query the data in HDFS.
Created and worked Sqoop jobs with incremental load to populate Hive External tables.
Configured various property files like core¬site.xml, hdfs¬site.xml, mapred¬site.xml based upon the job requirement.
Installed and configured RANGER security authentication for users to Hadoop components.
Basic knowledge in spark core, Streaming, and SQL.
Worked on Hive for ETL Transformations and optimized Hive queries.
Job workflow scheduling and monitoring using tools like Crontab and Nagios.
Working on Integrating Kafka with Spark Streaming.
Installed and configured Apache KAFKA messaging cluster.
Worked with relational database systems(RDBMS) such as SQL,
Good Knowledge of Snow and Outlook reporting tool. Analytics integrates reporting, modeling,analysis, dashboards,stories, and eventmanagement.
Worked on Remedy ticketing tool to raise or resolve incident requests.
Monitoring Ambari cluster health and HDFS space for better performance
Handling Ganglia & Nagios alerts to handle CPU, Memory, Storage and Network
Install Hadoop patches and version upgrades when required.
Importing and exporting data into HDFS using Sqoop.
Involving in Analyzing system failures, identifying root causes, and recommended course of actions. Documented the systems processes and procedures for future references.
Taking backup of HDFS data using snapshots and Distcp.
Working together with infrastructure, network and application teams to guarantee high data quality and availability.
Decommissioning and commissioning the data nodes on running hadoop cluster.
Currently I'm in cognizant technology solution india pvt Ltd. Hyderabad.
Conduct performance testing and monitoring of production systems.
Knowledge of Hadoop main components and Architecture such as HDFS, YARN,
MapReduce, Sqoop, Hive,Ranger, Knox, Kafka, Hbase, Kerberos etc.
Handled importing of data from various sources, and loaded data into HDFS.
Installed and configured Kerberos secutiry authentication.
UsedHIVE to read,write and query the data in HDFS.
Created and worked Sqoop jobs with incremental load to populate Hive External tables.
Configured various property files like core¬site.xml, hdfs¬site.xml, mapred¬site.xml based upon the job requirement.
Installed and configured RANGER security authentication for users to Hadoop components.
Basic knowledge in spark core, Streaming, and SQL.
Worked on Hive for ETL Transformations and optimized Hive queries.
Job workflow scheduling and monitoring using tools like Crontab and Nagios.
Working on Integrating Kafka with Spark Streaming.
Installed and configured Apache KAFKA messaging cluster.
Worked with relational database systems(RDBMS) such as SQL,
Good Knowledge of Snow and Outlook reporting tool. Analytics integrates reporting, modeling,analysis, dashboards,stories, and eventmanagement.
Worked on Remedy ticketing tool to raise or resolve incident requests.
Monitoring Ambari cluster health and HDFS space for better performance
Handling Ganglia & Nagios alerts to handle CPU, Memory, Storage and Network
Install Hadoop patches and version upgrades when required.
Importing and exporting data into HDFS using Sqoop.
Involving in Analyzing system failures, identifying root causes, and recommended course of actions. Documented the systems processes and procedures for future references.
Taking backup of HDFS data using snapshots and Distcp.
Working together with infrastructure, network and application teams to guarantee high data quality and availability.
Decommissioning and commissioning the data nodes on running hadoop cluster.
Bachelor of science.