{"schemaVersion":"jobsearcher.job.v1","id":"e857cf4a578a68e751dd7b5d","url":"https://jobsearcher.com/jobs/e857cf4a578a68e751dd7b5d","canonicalUrl":"https://jobsearcher.com/jobs/e857cf4a578a68e751dd7b5d","title":"Senior Apache Spark Developer","description":"Job Description\n\nIntroduction We are seeking a highly skilled individual to help build and expand our next-generation data processing platform. This role will focus on designing and developing distributed data processing solutions using Apache Spark while leveraging an existing enterprise Kafka ecosystem. The successful candidate will play a critical role in scaling our data processing capabilities, enabling cloud adoption, and supporting strategic migration initiatives involving Databricks and AWS. This position offers the opportunity to work on high-volume, mission-critical data platforms processing large-scale real-time and batch workloads.\r\nRequired Skills & Qualifications5 years of hands-on development experience with Apache Spark.\r\nStrong expertise in Spark SQL, Structured Streaming, DataFrames/Datasets, performance tuning, and optimization.\r\nExperience integrating Spark with Apache Kafka.\r\nStrong development skills in Java and Python.\r\nExperience designing and supporting large-scale distributed systems.\r\nSolid understanding of software engineering principles, object-oriented design, and testing practices.\r\nExperience working with relational and distributed data platforms.\r\nBachelor’s Degree\r\nPrior work experience at client or in client's Industry\r\nApplicants must be able to work directly for Artech on W2\r\nPreferred Skills & QualificationsDatabricks experience (SQL).\r\nAWS experience, including services such as S3, EMR, Glue, Lambda, ECS/EKS.\r\nExperience supporting large-scale cloud migration initiatives.\r\nExperience with lakehouse architectures and modern data platform patterns.\r\nExperience handling multi-terabyte or petabyte-scale datasets.\r\nFinancial services or regulated industry experience.\r\nDay-to-Day ResponsibilitiesDesign, develop, and optimize Spark-based applications for large-scale data processing.\r\nBuild streaming and batch data solutions leveraging Apache Kafka and Apache Spark.\r\nDevelop reusable frameworks and components supporting enterprise data engineering initiatives.\r\nSupport migration efforts from on-premises data platforms to Databricks and AWS.\r\nCollaborate with architects and platform engineers to implement cloud-native data solutions.\r\nOptimize Spark jobs for performance, scalability, reliability, and operational efficiency.\r\nParticipate in system design, code reviews, testing, and production support activities.\r\nImplement CI/CD, monitoring, and observability practices for distributed data applications.\r\nTroubleshoot and resolve complex issues across Spark, Kafka, Databricks, and cloud environments and with other enterprise messaging systems.\r\nFor immediate consideration please click APPLY to begin the screening process with Alex.","company":"Artech","rawCompany":"artech","city":"Oak Ridge","state":"NJ","isRemote":false,"isActive":false,"createdAt":"2026-11-03T01:56:30.466Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Apache Spark Developer","description":"Job Description\n\nIntroduction We are seeking a highly skilled individual to help build and expand our next-generation data processing platform. This role will focus on designing and developing distributed data processing solutions using Apache Spark while leveraging an existing enterprise Kafka ecosystem. The successful candidate will play a critical role in scaling our data processing capabilities, enabling cloud adoption, and supporting strategic migration initiatives involving Databricks and AWS. This position offers the opportunity to work on high-volume, mission-critical data platforms processing large-scale real-time and batch workloads.\r\nRequired Skills & Qualifications5 years of hands-on development experience with Apache Spark.\r\nStrong expertise in Spark SQL, Structured Streaming, DataFrames/Datasets, performance tuning, and optimization.\r\nExperience integrating Spark with Apache Kafka.\r\nStrong development skills in Java and Python.\r\nExperience designing and supporting large-scale distributed systems.\r\nSolid understanding of software engineering principles, object-oriented design, and testing practices.\r\nExperience working with relational and distributed data platforms.\r\nBachelor’s Degree\r\nPrior work experience at client or in client's Industry\r\nApplicants must be able to work directly for Artech on W2\r\nPreferred Skills & QualificationsDatabricks experience (SQL).\r\nAWS experience, including services such as S3, EMR, Glue, Lambda, ECS/EKS.\r\nExperience supporting large-scale cloud migration initiatives.\r\nExperience with lakehouse architectures and modern data platform patterns.\r\nExperience handling multi-terabyte or petabyte-scale datasets.\r\nFinancial services or regulated industry experience.\r\nDay-to-Day ResponsibilitiesDesign, develop, and optimize Spark-based applications for large-scale data processing.\r\nBuild streaming and batch data solutions leveraging Apache Kafka and Apache Spark.\r\nDevelop reusable frameworks and components supporting enterprise data engineering initiatives.\r\nSupport migration efforts from on-premises data platforms to Databricks and AWS.\r\nCollaborate with architects and platform engineers to implement cloud-native data solutions.\r\nOptimize Spark jobs for performance, scalability, reliability, and operational efficiency.\r\nParticipate in system design, code reviews, testing, and production support activities.\r\nImplement CI/CD, monitoring, and observability practices for distributed data applications.\r\nTroubleshoot and resolve complex issues across Spark, Kafka, Databricks, and cloud environments and with other enterprise messaging systems.\r\nFor immediate consideration please click APPLY to begin the screening process with Alex.","datePosted":"2026-11-03T01:56:30.466Z","dateModified":"2026-11-03T01:56:30.466Z","hiringOrganization":{"@type":"Organization","name":"Artech","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Oak Ridge","addressRegion":"NJ","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"e857cf4a578a68e751dd7b5d"},"url":"https://jobsearcher.com/jobs/e857cf4a578a68e751dd7b5d"}}