Job Title: Hadoop Architect -Remote Work
Duration: 3+ Years Contract
Location: Atlanta, Georgia, USA, 30308
***Manager prefers local candidates, but would consider remote.
Overall Purpose: Responsible for the development of distributed computing tasks which include MapReduce, NoSQL, and other distributed environment technologies based on need or preference to solve the problems that arise. Using programming languages and technology, writes code, completes programming and documentation, and performs testing and debugging of applications. Analyzes, designs, programs, debugs and modifies software enhancements and/or new products used in local, networked, or Internet-related computer programs. May interact with users to define system requirements and/or necessary modifications .
Roles & Responsibilities: 1) 8-10 years experience in developing software applications including: analysis, design, coding, testing, deploying and supporting of applications. 2) Proficient in application/software architecture (Definition, Business Process Modeling, etc.). 3) Project Management experience. 4) Experience building Big Data solutions using Hadoop technology. 5) Extensive experience with software development and the complete software lifecycle (analysis, design, implementation, testing, quality assurance). 6) Ability to work with non-technical resources on the team to translate data needs into Big Data solutions using the appropriate tools. 7) Extensive experience developing complex MapReduce programs against structured and unstructured data. 8) Experience with loading data to Hive and writing software accessing Hive data.
Must Skills are a +
Languages R, Scala and Ruby
Additional Hadoop related software Accumulo, Sqrrl, Atlas, NiFi and Cloudbreak
Monitoring software NagiosXi, Nagios Core
Docker or Kubernetes
HDP Certified Administrator
HDP Certified Developer
Experience with automation with chef for application deployment
Experience with deploying HDP via blueprints
Experience with Solr and Elastic Search administration and tuning
Tuning Hadoop applications using the ORC storage format
Experience with automation in Chef, Puppet, Ansible, and Jenkins
SAML SSO, PAM
Confluent, Apache Flink
Minimum of 3 years' experience with Red Hat Enterprise Linux 6/7 and UNIX administration supporting large scale environments
Minimum of 3 years' experience in administrative support of Hortonworks HDP, Cloudera or MapR
Minimum of 3 years' experience in administrative support of secured clusters with Kerberos
Minimum of 3 years' experience in administrative support Apache Kafka, Spark and streaming applications
Minimum of 1 year experience in hardening clusters with Knox and Ranger
Minimum of 1 year experience in LDAP integration with HDP and other tools
Minimum of 1 year experience with automation
Minimum of 1 year experience with Solr or Elastic Search administration and tuning experience.
Minimum of 1 year experience with supporting HBASE
Experience with issues that will affect a distributed system
Experience in supporting MySQL & NoSQL such as MongoDB
Experience in programming with Java, bash/ksh scripting and Python
Strong written communications and documentation experience
Responsibilities
Manage cluster hardening activities through the implementation and maintenance of security and governance components across various cluster.
Manage large scale Hadoop cluster environments, handling all Hadoop environment builds, including design, capacity planning, cluster setup, performance tuning, analyze Hadoop log files, support, maintenance, backups and ongoing monitoring
Work closely with network, infrastructure, Linux admin and application development teams ensuring data is completing within SLA
Identify hardware and software technical problems, storage and/or related system malfunctions. All root cause analysis results will be properly documented to minimize future system issues.
Continually work to automate administrative tasks while designing resiliency and high availability of the Hadoop platform
Manage and troubleshoot scheduled Hadoop jobs with TWS and Oozie.
Provide off hours support on a rotational basis to support installation, upgrades or production issues.
Mazhar Khan
||Tel: 703-962-7227 X 427 || Fax: 703-439-2550 ||
Email: mazhar@gsquire.com
Gsquire Business Solutions Inc || www.gsquire.com || 4229 Lafayette Center Dr , Suite #1625, Chantilly, VA 20151Women Owned Small Business / MBE / SWAM Certified
You received this message because you are subscribed to the Google Groups "US Jobs: Requirements, Clients and Consultants" group.
To unsubscribe from this group and stop receiving emails from it, send an email to recruiters-r-us+unsubscribe@googlegroups.com.
To post to this group, send email to recruiters-r-us@googlegroups.com.
Visit this group at https://groups.google.com/group/recruiters-r-us.
For more options, visit https://groups.google.com/d/optout.
No comments:
Post a Comment