Java Developer with Apache Spark experience (W2 Contract)
About the RoleJava Developer with Apache Spark experience (W2 Contract)Architect and build scalable, fault-tolerant data pipelines using Apache Spark (Java). Lead design of batch and streaming ETL/ELT systems handling large data volumes. Deep-dive performance tuning: partitioning strategy, memory management, shuffle/skew optimization, job cost reduction. Set coding standards and lead code/design reviews across the team. Drive technical decisions on data architecture, storage formats, and pipeline orchestration. Mentor mid-level and junior engineers; act as a technical escalation point. Partner with product, analytics, and platform teams to translate requirements into scalable systems. Own production reliability — on-call ownership, incident response, root-cause analysis for pipeline failures. Evaluate and introduce new tools/frameworks where they improve the system. Contribute to capacity planning and cost optimization for cluster infrastructure.ResponsibilitiesArchitect and build scalable, fault-tolerant data pipelines using Apache Spark (Java)Lead design of batch and streaming ETL/ELT systems handling large data volumesDeep-dive performance tuning: partitioning strategy, memory management, shuffle/skew optimization, job cost reductionSet coding standards and lead code/design reviews across the teamDrive technical decisions on data architecture, storage formats, and pipeline orchestrationMentor mid-level and junior engineers; act as a technical escalation pointPartner with product, analytics, and platform teams to translate requirements into scalable systemsOwn production reliability — on-call ownership, incident response, root-cause analysis for pipeline failuresEvaluate and introduce new tools/frameworks where they improve the systemContribute to capacity planning and cost optimization for cluster infrastructureQualificationsBachelor’s or Master’s degree in Computer Science, Engineering, or related fieldRequired Skills7+ years of professional Java Development experience5+ years hands-on experience with Apache Spark in production environmentsExpert-level understanding of distributed systems: fault tolerance, data locality, shuffle mechanics, resource managementProven track record designing systems processing terabyte+ scale dataStrong SQL skills and deep familiarity with columnar storage formats (Parquet, ORC, Avro, Delta Lake/Iceberg)Experience with cluster managers (YARN, Kubernetes) and cloud-managed SparkProficiency with KafkaStrong grasp of CI/CD, containerization, and infrastructure-as-code practicesPreferred SkillsExperience with Flink or other stream-processing frameworksFamiliarity with data governance, lineage, and quality frameworksExperience with workflow orchestration at scaleBackground in system design for multi-tenant or multi-region data platformsPrior experience leading a team or acting as a technical leadResponsibilitiesExcellent communication — able to explain technical tradeoffs to non-technical stakeholdersStrong mentorship and coaching abilityComfortable driving ambiguous, cross-team technical initiativesRequired SkillsGood Communication skills5 days Work from Office at Berkley Heights, NJTeam PlayerAbility to work in a changing environmentStrong problem solving and analytical skillsAbility to work independently or within a teamManage day-to-day challenges and communicate developmental risks with the technical team