Conducting cluster maintenance and creating and removing nodes. Participating in performance tuning of Hadoop clusters and Hadoop MapReduce routines. Screening Hadoop cluster job performances and capacity planning.
- Migrating clusters from Hortonworks Data Platform to a customer data platform
- Configuring Kerberos on Hortonworks Data Platform and Cloudera Manager
- Taking part in a data-delivering team to set up new Hadoop users
- Installing and configuring clusters with Hadoop stack and services, including Hive, HBase, Spark, Zookeeper, and Kafka
- Planning and deploying new Hadoop environments
- Optimizing performance by upgrading cluster and OS parameters
- Monitoring Hadoop cluster connectivity and security
- Managing and reviewing Hadoop log files
- Providing HDFS support and maintenance
- Teaming up with the infrastructure, network, database, application, and business intelligence teams to guarantee high data quality and availability
