Hadoop Developer
Hadoop Developer Scottsdale AZ - Day1 Onsite Contract
Note:
This role focuses strictly on the core Apache Big Data ecosystem running on bare metal.
Please note: This is not a cloud data engineering role. We do not utilize AWS, Azure, or GCP.
Core Responsibilities:
- Develop and optimize robust data pipelines using native HDFS, MapReduce, and YARN.
- Write high-performance distributed processing jobs using Apache Spark (Core/SQL) and Hive.
- Manage cluster resource allocation, troubleshoot bottlenecks, and tune query performance at the core infrastructure level.•Hands-on experience with build tools like Maven and/or Gradle.•Strong understanding of distributed systems and big data architecture.•Experience with streaming frameworks such as Spark Streaming and Kafka Streams. Required Skills & Qualifications
- Proven experience as a dedicated Big Data / Hadoop Developer.
- Mastery of the core Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, Oozie).
- Strong proficiency in Apache Spark using Java, Scala, or Python.
- Deep understanding of distributed storage, cluster performance tuning, and Linux environments.
- Note: Cloud-native engineers (AWS EMR/Glue, Azure Synapse/ADF) will not be considered for this specific on-premise role.