· Manage scalable Hadoop virtual and physical cluster environments. · Manage the backup and disaster recovery for Hadoop data. · Optimize and tune the Hadoop environments to meet performance requirements. · Install and configure monitoring tools for all the critical Hadoop systems and services. · Work in tandem with big data developers and designs use case specific scalable supportable -infrastructure. · Provide very responsive support for day to day requests from, development, support, and business analyst teams. · Performance analysis and debugging of slow running development and production processes. · Solid technical understanding of services such as Hbase, kafka, spark, Hive, hdfs, yarn and ambari. · Work with Linux server admin team in administering the server hardware and operating system. · Assist with development and maintain the system documentation. · Create and publish various production metrics including system performance and reliability information to systems owners and management. · Perform ongoing capacity management forecasts including timing and budget considerations. · Coordinate root cause analysis (RCA) efforts to minimize future system issues. · Mentor, develop and train other systems operations staff members as needed. · Provide off hour support as required · Isilon based hadoop experience is a plus. Technical Qualifications: 1) At least 3 years experience in install and configure hortonworks hadoop cluster 2) Backup and recovery of HDFS file system (distributed filesystem java based) 3) mySQL databases used by Cluster 4) Configure and maintain HA of HDFS, YARN (yet another resource negotiator) Resource Manager. , MapReduce, Hive, HBASE, Kafka and Spark 5) Experience setting up Kerberos and administering a kerberized cluster. 6) Ranger Service configuration and setup policies. (authentication) 7) Knox service configuration. (reverse proxy, policy enforcement for Hadoop)…access control 8) String understanding and experience to use ODBC/JDBC with various clients like tableau, Microstrategy and server components like hive/spark and hbase 9) Diagnose and resolve individual service issues. 10) Monitor and tune cluster component performance. 11) Very strong skill in using various Linux commands for day to day operations and ability to analyze and create Shell scripts. |
No comments:
Post a Comment