Hadoop Support with Devops
Hadoop Support With Devops
Location:
Plano, TXFull TimeSkill: Hadoop Support with DevOpsMust Have Technical/Functional Skills:
Primary Skill: Hadoop
Secondary: Linux, DevOpsExperience: Minimum 10 years
Roles & Responsibilities: Primary - Hadoop, Secondary Linux with Devops
Key Responsibilities:
- L1, L2 & L3 level support in Hadoop Platform
- Monitor and resolve HDFS and Ozone related issues.
- Investigate cluster performance, storage utilization, and capacity concerns.
- Manage quota requests, storage allocation, and capacity planning.
- Support platform maintenance and perform integration activities.
- Coordinate with application teams during incident and problem management.
- Create and maintain operational documentation, runbooks, and knowledge articles.
Required Qualifications:
Experience on L1, L2 & L3 level support in Hadoop in Yarn, Spark and Impala job debugging and troubleshooting.
Experience in addressing issues around NameNode, HDFS Space, File/Folder Permission & backups.
Understanding and experience in query performance tuning and resource utilization tuning.
Technical knowledge on relational databases, data warehousing and SQL skills.
Hadoop, Kafka, Spark, Impala, Hive, HBase, Ozone etc.
Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster and Hadoop Administrator’s role.
Intimate knowledge of fully integrated AD/Kerberos setting up optimum cluster knowledge of YARN.Hands-on with analyzing various Hadoop log files, compression, encoding, & file level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper and Postgres.
Strong technical knowledge: Unix/Linux; Database (Sybase/SQL/Oracle), Java, Python, Perl, Shell scripting, Infrastructure.
Experience in Monitoring & Alerting, and Job Scheduling Systems.
Being comfortable with frequent, incremental code testing and deployment.
Strong grasp of automation / DevOps tools - Ansible, Jenkins, SVN, Bitbucket.
Tools Involved:
ETL tools: Hadoop StackJob Scheduling tools: AutosysBI tools: Tableau; Tableau dashboard building connecting Hadoop-Hive Tables is equally preferred.