Java Spark Lead Developer

Overview In this role, you will lead the design, development, and deployment of scalable big data solutions using Java and Apache Spark. You’ll drive end-to-end data pipelines and ETL workflows while mentoring peers on a fast-paced data engineering team. You will build RESTful services with Spring Boot and collaborate with analysts to translate requirements into robust data architectures. You’ll optimize Spark jobs for performance and reliability, and guide technical decisions in an Agile environment. This is an opportunity to shape data platforms at scale and influence engineering practices across the team. ResponsibilitiesLead design and implementation of big data processing solutions with Spark and JavaDevelop scalable data pipelines and ETL workflows using Spark and Hadoop ecosystem toolsBuild RESTful APIs with Spring Boot to support data servicesCollaborate with Business Analysts to refine requirementsHandle end-to-end development including design, coding, testing, and deploymentTroubleshoot complex production issues in Spark jobs and pipelinesConduct code reviews and enforce coding standardsOptimize Spark jobs for performance, scalability, and reliabilityMentor junior/intermediate developers and provide technical guidanceParticipate in Agile sprint planning and reviews Key requirements7+ years of software development experienceAt least 3 years in a technical lead role with Java/SparkStrong Spark experience for large-scale data processingProficiency in SQL and experience with OracleExperience with CI/CD pipelines (Jenkins, GitLab CI)Familiarity with Autosys for job scheduling/automationProven ability to lead technical projects and mentor teamsStrong problem-solving, analytical, and debugging skillsleadershipmentoringproblem-solvingApache SparkJavaSpring Boot