Hadoop Consultant / Admin

Location: Norfolk, VA
Date Posted: 01-26-2018
Please find the details of the requirement. Let me know your interest in this position along with your updated resume
Title: Hadoop Consultant / Admin
Location: Norfolk, VA
Duration: 6 Months Contract to Hire
Set up and manage Hadoop clusters with optimum configurations
Drive automation of Hadoop deployments, cluster expansion and maintenance operations
Manage monitoring alerts and notification
Deployment of upgrades, updates and patches
Diagnosis of installation & configuration issues
Diagnosis of cluster management issues
Diagnosis of performance issues
Job scheduling, monitoring, debugging and troubleshooting
Monitoring and management of the cluster in all respects, notably availability, performance and security
File system management and monitoring
Monitor and diagnose data transfer between Hadoop and other data stores (incl. relational database)
Ingesting additional data sources into Hadoop in either streaming or batch mode
Commissioning and decommissioning worker nodes
Configuring the cluster to be rack-aware
Set up High Availability/Disaster Recovery environment
Debug/Troubleshoot environment failures/downtime
Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos/security configurations and testing HDFS, Hive, Pig and MapReduce access for the new users
Performance tuning of Hadoop clusters and Hadoop Map Reduce routines
Manage and review Hadoop log files.
Required Experience/Skills:
Should know Spark Scala
Working on Hortonworks is preferred as we are using Hortonworks
Experience with large scale Hadoop environments build and support including design, capacity planning, cluster set up, performance tuning and monitoring
Strong understanding of Hadoop eco system such as HDFS, MapReduce, HBase, Pig, Hadoop streaming, and hive
Experience in installing, administering, and supporting Linux operating systems and hardware in an enterprise environment
Expertise in typical system administration and programming skills such as storage capacity management, performance tuning
Experience in setup, configuration and management of security for Hadoop clusters using Kerberos and integration with LDAP/AD at an Enterprise level
Should be able to handle both development and PS (admin)
Phone: 248-415-4549
Fax: 248-603-2599

At least a bachelor’s degree in Computer Science, Engineering or related field or an equivalent in education is required for this position.
We are an Equal Opportunity Employer.
this job portal is powered by CATS