Key Responsibilities :
A. Performance tuning of Hadoop clusters and Hadoop Map Reduce routines
B. Screen Hadoop cluster job performances and capacity planning
C. Monitor Hadoop cluster connectivity and security
D. Manage and review Hadoop log files
Technical Experience :
A. 4 years of experience installing configuring and administrating Hadoop infrastructure
B. Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
C. Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users setting up Kerberos principals and testing HDFS Hive Pig and Map Reduce access for the new users.
Professional Attributes :
A. Diligently teaming with the infrastructure network database application and business intelligence teams to guarantee high data quality and availability
B. Collaborating with application teams to install operating system and Hadoop updates patches version upgrades when required