Hadoop Administrator / Big Data Engineer
Job Role: Hadoop Administrator Location: Berkeley heights, NJ / Atlanta, GA (Hybrid)Mode of Hiring: Long Term Contract Job Summary:We are seeking an experienced Hadoop Administrator / Big Data Engineer to install, configure, maintain, and optimize large-scale Hadoop clusters and Big Data environments. The ideal candidate should have strong hands-on experience with Apache Hadoop ecosystem components including HDFS, Spark, and YARN along with cluster monitoring, troubleshooting, and performance tuning.Key Responsibilities:Install, configure, and maintain clusters based on Apache Hadoop.Administer distributed storage using Apache HDFS.Deploy and manage compute workloads using Apache Spark.Manage cluster resource allocation through Apache Hadoop YARN.Monitor Hadoop cluster health, performance, and capacity planning.Perform cluster upgrades, patches, and security implementations.Troubleshoot production issues and provide root cause analysis.Configure and manage high availability and disaster recovery solutions.Work closely with Data Engineers, Developers, and DevOps teams.Optimize Spark jobs and Hadoop ecosystem performance.Implement monitoring tools and automation scripts.Ensure data integrity, security, and compliance standards are maintained.Support ETL and large-scale data processing operations.Required Skills:Strong experience in Apache Hadoop ecosystem.HadoopHDFSSparkYARNHiveKafkaSqoopHBaseGood knowledge of Linux/Unix administration.Experience with Shell scripting or Python scripting.Strong understanding of distributed systems and cluster management.Experience in performance tuning and troubleshooting.Familiarity with cloud platforms such as AWS, Azure, or GCP is preferred.Knowledge of DevOps tools and CI/CD pipelines is a plus.Qualifications:Bachelor’s Degree in Computer Science, Information Technology, or related field.5+ years of experience in Hadoop Administration / Big Data Engineering.Excellent analytical and problem-solving skills.Strong communication and collaboration abilities.